Apr 15 16:02:34 devstack cinder-volume[72676]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 16:02:34 devstack cinder-volume[72676]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 16:02:34 devstack cinder-volume[72676]: we strongly recommend against using it for new projects. Apr 15 16:02:34 devstack cinder-volume[72676]: If you are already using Eventlet, we recommend migrating to a different Apr 15 16:02:34 devstack cinder-volume[72676]: framework. For more detail see Apr 15 16:02:34 devstack cinder-volume[72676]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 16:02:34 devstack cinder-volume[72676]: import eventlet # noqa Apr 15 16:02:35 devstack cinder-volume[72676]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 16:02:35 devstack cinder-volume[72676]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 16:02:35 devstack cinder-volume[72676]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 16:02:36 devstack cinder-volume[72676]: INFO dbcounter [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Registered counter for database cinder Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_db.sqlalchemy.engines [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG dbcounter [-] [72676] Writer thread running {{(pid=72676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 16:02:36 devstack cinder-volume[72676]: INFO cinder.rpc [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 16:02:36 devstack cinder-volume[72676]: INFO cinder.rpc [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_db.sqlalchemy.engines [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:02:36 devstack cinder-volume[72676]: INFO cinder.volume.manager [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Determined volume DB was empty at startup. Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG cinder.volume.manager [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72676) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 16:02:36 devstack cinder-volume[72676]: INFO cinder.volume.manager [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 16:02:36 devstack cinder-volume[72676]: WARNING stevedore.named [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 16:02:36 devstack cinder-volume[72676]: WARNING castellan.key_manager [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 16:02:36 devstack cinder-volume[72676]: WARNING cinder.keymgr.conf_key_mgr [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG cinder.volume.drivers.lvm [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72676) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_concurrency.processutils [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_concurrency.processutils [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] CMD "cinder-rtstool verify" returned: 0 in 0.277s {{(pid=72676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_db.sqlalchemy.engines [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:02:36 devstack cinder-volume[72676]: INFO cinder.rpc [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 16:02:36 devstack cinder-volume[72676]: INFO cinder.rpc [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 16:02:36 devstack cinder-volume[72676]: WARNING stevedore.named [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 16:02:36 devstack cinder-volume[72676]: WARNING castellan.key_manager [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 16:02:36 devstack cinder-volume[72676]: INFO cinder.volume.manager [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_db.sqlalchemy.engines [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:02:36 devstack cinder-volume[72676]: INFO oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Starting 1 workers Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Started child 72781 {{(pid=72676) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Full set of CONF: {{(pid=72676) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] ******************************************************************************** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Configuration options gathered from: {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] ================================================================================ {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] allow_availability_zone_fallback = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] allow_compression_on_image_upload = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] allowed_direct_url_schemes = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] api_rate_limit = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] auth_strategy = keystone {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] az_cache_duration = 3600 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_availability_zone = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_host = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_stats_polling_interval = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backup_api_class = cinder.backup.api.API {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backup_name_template = backup-%s {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backup_use_same_host = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backup_use_temp_snapshot = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] chap_password = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] chap_username = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_internal_tenant_project_id = 6f9e99c63ebe43caac3f11f6159db4f1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_internal_tenant_user_id = de1716d0dfb242cca2c2ee55b19231a6 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cloned_volume_same_az = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cluster = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] compression_format = gzip {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] compute_api_class = cinder.compute.nova.API {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] config_dir = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] config_source = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] control_exchange = openstack {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] debug = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] default_availability_zone = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] default_group_type = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] default_volume_type = lvmdriver-1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] disk_geometry = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] driver_client_cert = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72781]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] driver_client_cert_key = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] driver_data_namespace = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] driver_ssl_cert_path = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] driver_ssl_cert_verify = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] driver_use_ssl = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] enable_force_upload = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] enable_new_services = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] enable_unsupported_driver = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] enforce_multipath_for_image_xfer = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] filter_function = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_api_insecure = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_api_ssl_compression = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_ca_certificates_file = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_catalog_info = image:glance:publicURL {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_certfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_keyfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_num_retries = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance_request_timeout = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] goodness_function = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] graceful_shutdown_timeout = 5 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] group_api_class = cinder.group.api.API {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:36 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] host = devstack {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_compress_on_upload = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_conversion_address_space_limit = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_conversion_cpu_limit = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_conversion_disable = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_upload_use_cinder_backend = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_upload_use_internal_tenant = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_volume_cache_enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_volume_cache_max_count = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] image_volume_cache_max_size_gb = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] init_host_max_objects_retrieval = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] instance_format = [instance: %(uuid)s] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] iscsi_target_flags = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] iscsi_write_cache = on {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] iser_helper = tgtadm {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] iser_ip_address = 192.168.122.62 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] iser_port = 3260 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_color = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_config_append = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_dir = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_file = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_options = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_rotate_interval = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_rotate_interval_type = days {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] log_rotation_type = none {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] max_age = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] max_logfile_count = 30 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] max_logfile_size_mb = 200 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] max_over_subscription_ratio = 20.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] message_reap_interval = 86400 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] message_ttl = 2592000 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] migration_create_volume_timeout_secs = 300 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] monkey_patch = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] monkey_patch_modules = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] my_ip = 192.168.122.62 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] no_snapshot_gb_quota = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] num_iser_scan_tries = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] num_shell_tries = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] num_volume_device_scan_tries = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] nvmeof_conn_info_version = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] nvmet_ns_id = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] nvmet_port_id = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] osapi_max_limit = 1000 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] osapi_volume_ext_list = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72781]: INFO cinder.volume.manager [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] osapi_volume_listen_port = 8776 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] osapi_volume_use_ssl = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] osapi_volume_workers = 2 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] per_volume_size_limit = -1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] periodic_fuzzy_delay = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] periodic_interval = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] public_endpoint = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] publish_errors = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] quota_backup_gigabytes = 1000 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] quota_backups = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] quota_gigabytes = 1000 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] quota_groups = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] quota_snapshots = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] quota_volumes = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] rate_limit_burst = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] rate_limit_except_level = CRITICAL {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] rate_limit_interval = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] reinit_driver_count = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] replication_device = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] report_discard_supported = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] report_interval = 120 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] reservation_clean_interval = 86400 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] reservation_expire = 86400 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] reserved_image_namespaces = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] reserved_percentage = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] rpc_response_timeout = 120 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] run_external_periodic_tasks = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] scst_target_driver = iscsi {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] scst_target_iqn_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_down_time = 720 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] shell_completion = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] snapshot_name_template = snapshot-%s {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] snapshot_same_host = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] split_loggers = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] state_path = /opt/stack/data/cinder {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] storage_availability_zone = nova {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] storage_protocol = iSCSI {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] syslog_log_facility = LOG_USER {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] target_helper = lioadm {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] target_ip_address = 192.168.122.62 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] target_port = 3260 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] target_protocol = iscsi {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] target_secondary_ip_addresses = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] trace_flags = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] transport_url = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] until_refresh = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] use_chap_auth = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] use_default_quota_class = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] use_journal = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] use_json = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] use_multipath_for_image_xfer = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] use_stderr = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] use_syslog = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] verify_glance_signatures = enabled {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_api_class = cinder.volume.api.API {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_backend_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_clear = zero {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_clear_ionice = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_clear_size = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_copy_bps_limit = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_dd_blocksize = 1M {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_name_template = volume-%s {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_service_inithost_offload = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volume_usage_audit_period = month {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] zoning_mode = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_concurrency.disable_process_locking = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.admin_password = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.admin_token = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.admin_user = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.auth_port = 35357 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.auth_protocol = https {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.auth_section = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.auth_type = password {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.auth_uri = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.auth_version = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.cache = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.certfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.identity_uri = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.include_service_catalog = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.insecure = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.interface = public {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.keyfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_password = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcache_username = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.region_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.service_type = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.backend = dogpile.cache.null {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.backend_argument = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.backend_expiration_time = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.config_prefix = cache.oslo {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.debug_cache_backend = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.enable_retry_client = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.enable_socket_keepalive = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.enforce_fips_mode = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.expiration_time = 600 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.hashclient_retry_attempts = 2 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.memcache_dead_retry = 300 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.memcache_pool_maxsize = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.memcache_sasl_enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.password = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.proxies = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.redis_db = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.redis_server = localhost:6379 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.retry_attempts = 2 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.retry_delay = 0.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.socket_keepalive_count = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.socket_keepalive_idle = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.socket_keepalive_interval = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.socket_timeout = 1.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.tls_allowed_ciphers = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.tls_cafile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.tls_certfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.tls_enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.tls_keyfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cache.username = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] coordination.backend_url = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.asyncio_connection = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.asyncio_slave_connection = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.backend = sqlalchemy {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.connection = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.connection_debug = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.connection_parameters = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.connection_recycle_time = 3600 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.connection_trace = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.db_inc_retry_interval = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.db_max_retries = 20 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.db_max_retry_interval = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.db_retry_interval = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.max_overflow = 50 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.max_pool_size = 5 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.max_retries = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.mysql_wsrep_sync_wait = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.pool_timeout = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.retry_interval = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.slave_connection = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.sqlite_synchronous = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.synchronous_reader = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] database.use_db_reconnect = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.connection_string = messaging:// {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.es_doc_type = notification {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.es_scroll_size = 10000 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.es_scroll_time = 2m {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.filter_error_trace = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.hmac_keys = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.sentinel_service_name = mymaster {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.socket_timeout = 0.1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack sudo[72786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.trace_requests = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack sudo[72786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler.trace_sqlalchemy = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler_jaeger.process_tags = {} {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler_jaeger.service_name_prefix = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] profiler_otlp.service_name_prefix = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.enforce_new_defaults = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: WARNING oslo_config.cfg [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.enforce_scope = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.policy_default_rule = default {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.policy_file = policy.yaml {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] privsep_osbrick.group = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] privsep_osbrick.helper_command = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] privsep_osbrick.user = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_sys_admin.group = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_sys_admin.helper_command = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] cinder_sys_admin.user = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.auth_section = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.auth_type = password {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.cafile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.certfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.collect_timing = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.insecure = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.keyfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.send_service_user_token = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.split_loggers = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] service_user.timeout = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.auth_section = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.auth_type = password {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.certfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.collect_timing = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.insecure = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.keyfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.region_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.split_loggers = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] glance.timeout = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.backend_availability_zone = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.chap_password = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.chap_username = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.disk_geometry = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.driver_client_cert = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.driver_client_cert_key = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.driver_data_namespace = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.driver_use_ssl = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.extra_capabilities = {} {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.filter_function = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.goodness_function = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.iscsi_target_flags = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.iscsi_write_cache = on {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.iser_helper = tgtadm {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.iser_port = 3260 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.lvm_share_target = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.lvm_type = auto {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.num_shell_tries = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.replication_device = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.report_discard_supported = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.reserved_percentage = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.target_helper = tgtadm {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.target_port = 3260 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.target_protocol = iscsi {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.trace_flags = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.unique_fqdn_network = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.use_chap_auth = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_backend_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_clear = zero {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_clear_ionice = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_clear_size = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_reports.file_event_handler = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_reports.log_dir = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.backend_host = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.chap_password = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.chap_username = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.disk_geometry = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.driver_client_cert = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.extra_capabilities = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.filter_function = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.goodness_function = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.iser_helper = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.iser_ip_address = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.iser_port = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.lvm_share_target = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.lvm_type = auto {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.num_shell_tries = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.replication_device = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.report_discard_supported = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.reserved_percentage = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.scst_target_driver = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.storage_protocol = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.target_helper = lioadm {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.target_ip_address = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.target_port = 3260 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.trace_flags = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.use_chap_auth = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_clear = zero {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_clear_size = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] lvmdriver-1.volumes_dir = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.ssl = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_notifications.driver = [] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_notifications.retry = -1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] key_manager.fixed_key = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.barbican_api_version = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.barbican_endpoint = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.barbican_endpoint_type = public {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.barbican_region_name = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.cafile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.certfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.collect_timing = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.insecure = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.keyfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.number_of_retries = 60 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.retry_delay = 1 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.send_service_user_token = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.split_loggers = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.timeout = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.verify_ssl = True {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican.verify_ssl_path = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.auth_section = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.auth_type = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.cafile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.certfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.collect_timing = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.insecure = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.keyfile = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.split_loggers = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] barbican_service_user.timeout = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.approle_role_id = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.approle_secret_id = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.kv_mountpoint = secret {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.kv_path = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.kv_version = 2 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.namespace = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.root_token_id = **** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.ssl_ca_crt_file = None {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.timeout = 60.0 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.use_ssl = False {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:02:37 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] ******************************************************************************** {{(pid=72676) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 16:02:37 devstack sudo[72786]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:37 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:37 devstack sudo[72791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:37 devstack sudo[72791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:38 devstack sudo[72791]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:38 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.558s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:38 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:02:38 devstack cinder-volume[72781]: INFO cinder.brick.local_dev.lvm [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 16:02:38 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:38 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:38 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:38 devstack sudo[73036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:02:38 devstack sudo[73036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:38 devstack sudo[73036]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:38 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.554s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:38 devstack cinder-volume[72781]: DEBUG cinder.brick.local_dev.lvm [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72781) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 16:02:38 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:38 devstack sudo[73258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:38 devstack sudo[73258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:39 devstack sudo[73258]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:39 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.097s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:39 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:40 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:40 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:40 devstack sudo[73428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:40 devstack sudo[73428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:40 devstack sudo[73428]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:40 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:40 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:40 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:40 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:40 devstack sudo[73481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 16:02:40 devstack sudo[73481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:40 devstack sudo[73481]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:40 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.431s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:40 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:40 devstack sudo[73484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:02:40 devstack sudo[73484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:41 devstack sudo[73484]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:41 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:41 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:41 devstack sudo[73490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:02:41 devstack sudo[73490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:41 devstack sudo[73490]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:41 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:41 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:41 devstack sudo[73493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:02:41 devstack sudo[73493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:42 devstack sudo[73493]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:42 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:42 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:42 devstack sudo[73498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:42 devstack sudo[73498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:42 devstack sudo[73498]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:42 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.410s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:42 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:42 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:42 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:42 devstack sudo[73505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:42 devstack sudo[73505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:43 devstack sudo[73505]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:43 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:43 devstack cinder-volume[72781]: INFO cinder.volume.drivers.lvm [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 16:02:43 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:43 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:43 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:43 devstack sudo[73514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:43 devstack sudo[73514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:43 devstack sudo[73514]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:43 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.511s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:43 devstack cinder-volume[72781]: DEBUG cinder.volume.drivers.lvm [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Updating volume stats {{(pid=72781) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 16:02:43 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:43 devstack sudo[73634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:02:43 devstack sudo[73634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:44 devstack sudo[73634]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:44 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:44 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:44 devstack sudo[73649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:02:44 devstack sudo[73649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:44 devstack sudo[73649]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:44 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:44 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:44 devstack sudo[73813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:44 devstack sudo[73813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:45 devstack sudo[73813]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:45 devstack sudo[73817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:02:45 devstack sudo[73817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:45 devstack sudo[73817]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:45 devstack cinder-volume[72781]: INFO cinder.volume.driver [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Driver hasn't implemented _init_vendor_properties() Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG cinder.volume.driver [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72781) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG oslo_db.sqlalchemy.engines [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72781) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG dbcounter [-] [72781] Writer thread running {{(pid=72781) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG cinder.db.sqlalchemy.api [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Building query based on filter {{(pid=72781) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG cinder.image.image_utils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72781) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 16:02:45 devstack cinder-volume[72781]: INFO cinder.keymgr.migration [None req-43924ce8-b711-4da5-a54f-cac832fc9193 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG cinder.volume.drivers.lvm [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Updating volume stats {{(pid=72781) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 16:02:45 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:45 devstack sudo[73821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:02:45 devstack sudo[73821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:46 devstack sudo[73821]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:46 devstack sudo[73825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:02:46 devstack sudo[73825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:46 devstack sudo[73825]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:46 devstack sudo[73831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:46 devstack sudo[73831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:46 devstack cinder-volume[72676]: DEBUG dbcounter [-] [72676] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:02:47 devstack sudo[73831]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:47 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.538s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:47 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:47 devstack sudo[73837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:02:47 devstack sudo[73837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:47 devstack sudo[73837]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:47 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:47 devstack cinder-volume[72781]: DEBUG cinder.manager [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Notifying Schedulers of capabilities ... {{(pid=72781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:02:47 devstack cinder-volume[72781]: INFO cinder.volume.manager [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Driver initialization completed successfully. Apr 15 16:02:47 devstack cinder-volume[72781]: INFO cinder.manager [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Initiating service 2 cleanup Apr 15 16:02:47 devstack cinder-volume[72781]: INFO cinder.manager [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Service 2 cleanup completed. Apr 15 16:02:47 devstack cinder-volume[72781]: DEBUG cinder.service [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Creating RPC server for service cinder-volume {{(pid=72781) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 16:02:47 devstack cinder-volume[72781]: DEBUG cinder.service [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72781) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 16:02:47 devstack cinder-volume[72781]: INFO cinder.volume.manager [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 16:02:47 devstack cinder-volume[72781]: DEBUG cinder.volume.drivers.lvm [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Updating volume stats {{(pid=72781) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 16:02:47 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:47 devstack sudo[73842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:02:47 devstack sudo[73842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:48 devstack sudo[73842]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:48 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:48 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:48 devstack sudo[73845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:02:48 devstack sudo[73845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:48 devstack sudo[73845]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:48 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:48 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:48 devstack sudo[73905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:02:48 devstack sudo[73905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:49 devstack sudo[73905]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:49 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:49 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:02:49 devstack sudo[73908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:02:49 devstack sudo[73908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:02:49 devstack sudo[73908]: pam_unix(sudo:session): session closed for user root Apr 15 16:02:49 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:02:49 devstack cinder-volume[72781]: INFO cinder.volume.manager [None req-6dbd984e-7517-4e67-95d1-b9d6dd97b26f None None] Driver post RPC initialization completed successfully. Apr 15 16:02:59 devstack cinder-volume[72781]: DEBUG dbcounter [-] [72781] Writing DB stats cinder:SELECT=5 {{(pid=72781) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:02:59 devstack cinder-volume[72781]: DEBUG dbcounter [-] [72781] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72781) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:03:45 devstack cinder-volume[72781]: DEBUG oslo_service.periodic_task [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72781) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:03:45 devstack cinder-volume[72781]: DEBUG cinder.volume.drivers.lvm [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Updating volume stats {{(pid=72781) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 16:03:45 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:03:45 devstack sudo[78578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:03:45 devstack sudo[78578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:03:46 devstack sudo[78578]: pam_unix(sudo:session): session closed for user root Apr 15 16:03:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:03:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:03:46 devstack sudo[78632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:03:46 devstack sudo[78632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:03:46 devstack sudo[78632]: pam_unix(sudo:session): session closed for user root Apr 15 16:03:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:03:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:03:46 devstack sudo[78640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:03:46 devstack sudo[78640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:03:46 devstack sudo[78640]: pam_unix(sudo:session): session closed for user root Apr 15 16:03:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:03:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:03:46 devstack sudo[78644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:03:46 devstack sudo[78644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:03:47 devstack sudo[78644]: pam_unix(sudo:session): session closed for user root Apr 15 16:03:47 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:03:47 devstack cinder-volume[72781]: DEBUG cinder.manager [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Notifying Schedulers of capabilities ... {{(pid=72781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:04:45 devstack cinder-volume[72781]: DEBUG oslo_service.periodic_task [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72781) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:04:45 devstack cinder-volume[72781]: DEBUG cinder.volume.drivers.lvm [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Updating volume stats {{(pid=72781) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 16:04:45 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:04:45 devstack sudo[79586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:04:45 devstack sudo[79586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:04:46 devstack sudo[79586]: pam_unix(sudo:session): session closed for user root Apr 15 16:04:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:04:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:04:46 devstack sudo[79599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:04:46 devstack sudo[79599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:04:46 devstack sudo[79599]: pam_unix(sudo:session): session closed for user root Apr 15 16:04:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:04:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:04:46 devstack sudo[79638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:04:46 devstack sudo[79638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:04:46 devstack sudo[79638]: pam_unix(sudo:session): session closed for user root Apr 15 16:04:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:04:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:04:46 devstack sudo[79677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:04:46 devstack sudo[79677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:04:47 devstack sudo[79677]: pam_unix(sudo:session): session closed for user root Apr 15 16:04:47 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:04:47 devstack cinder-volume[72781]: DEBUG cinder.manager [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Notifying Schedulers of capabilities ... {{(pid=72781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:04:59 devstack cinder-volume[72781]: DEBUG dbcounter [-] [72781] Writing DB stats cinder:SELECT=1 {{(pid=72781) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:04:59 devstack cinder-volume[72781]: DEBUG dbcounter [-] [72781] Writing DB stats cinder:UPDATE=1 {{(pid=72781) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:05:45 devstack cinder-volume[72781]: DEBUG oslo_service.periodic_task [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72781) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:05:45 devstack cinder-volume[72781]: DEBUG cinder.volume.drivers.lvm [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Updating volume stats {{(pid=72781) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 16:05:45 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:05:45 devstack sudo[81320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 16:05:45 devstack sudo[81320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:05:46 devstack sudo[81320]: pam_unix(sudo:session): session closed for user root Apr 15 16:05:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:05:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:05:46 devstack sudo[81324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:05:46 devstack sudo[81324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:05:46 devstack sudo[81324]: pam_unix(sudo:session): session closed for user root Apr 15 16:05:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:05:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:05:46 devstack sudo[81338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 16:05:46 devstack sudo[81338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:05:46 devstack sudo[81338]: pam_unix(sudo:session): session closed for user root Apr 15 16:05:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:05:46 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:05:46 devstack sudo[81345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 16:05:46 devstack sudo[81345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:05:47 devstack sudo[81345]: pam_unix(sudo:session): session closed for user root Apr 15 16:05:47 devstack cinder-volume[72781]: DEBUG oslo_concurrency.processutils [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72781) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:05:47 devstack cinder-volume[72781]: DEBUG cinder.manager [None req-de5b99a7-cb9b-43fe-985d-0b278d1d3676 None None] Notifying Schedulers of capabilities ... {{(pid=72781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:06:07 devstack cinder-volume[72676]: INFO oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Caught SIGTERM, stopping children Apr 15 16:06:07 devstack cinder-volume[72676]: DEBUG oslo_concurrency.lockutils [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Acquiring lock "singleton_lock" {{(pid=72676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 16:06:07 devstack cinder-volume[72676]: DEBUG oslo_concurrency.lockutils [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Acquired lock "singleton_lock" {{(pid=72676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 16:06:07 devstack cinder-volume[72676]: DEBUG oslo_concurrency.lockutils [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Releasing lock "singleton_lock" {{(pid=72676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 16:06:07 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Stop services. {{(pid=72676) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 16:06:07 devstack cinder-volume[72676]: DEBUG oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Killing children. {{(pid=72676) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 16:06:07 devstack cinder-volume[72676]: INFO oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Waiting on 1 children to exit Apr 15 16:06:07 devstack cinder-volume[72781]: DEBUG oslo_concurrency.lockutils [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Acquiring lock "singleton_lock" {{(pid=72781) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 16:06:07 devstack cinder-volume[72781]: DEBUG oslo_concurrency.lockutils [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Acquired lock "singleton_lock" {{(pid=72781) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 16:06:07 devstack cinder-volume[72781]: DEBUG oslo_concurrency.lockutils [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Releasing lock "singleton_lock" {{(pid=72781) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 16:06:07 devstack cinder-volume[72781]: WARNING amqp [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 16:06:07 devstack cinder-volume[72781]: WARNING amqp [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 16:06:07 devstack cinder-volume[72676]: INFO oslo_service.backend._eventlet.service [None req-49eb74a8-f413-494b-ad3a-8e8a83a0da09 None None] Child 72781 exited with status 0 Apr 15 16:06:07 devstack cinder-volume[81881]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 16:06:07 devstack cinder-volume[81881]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 16:06:07 devstack cinder-volume[81881]: we strongly recommend against using it for new projects. Apr 15 16:06:07 devstack cinder-volume[81881]: If you are already using Eventlet, we recommend migrating to a different Apr 15 16:06:07 devstack cinder-volume[81881]: framework. For more detail see Apr 15 16:06:07 devstack cinder-volume[81881]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 16:06:07 devstack cinder-volume[81881]: import eventlet # noqa Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 16:06:10 devstack cinder-volume[81881]: INFO dbcounter [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Registered counter for database cinder Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_db.sqlalchemy.engines [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81881) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG dbcounter [-] [81881] Writer thread running {{(pid=81881) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 16:06:10 devstack cinder-volume[81881]: INFO cinder.rpc [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 16:06:10 devstack cinder-volume[81881]: INFO cinder.rpc [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_db.sqlalchemy.engines [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81881) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:06:10 devstack cinder-volume[81881]: INFO cinder.volume.manager [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Determined volume DB was empty at startup. Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG cinder.volume.manager [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81881) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 16:06:10 devstack cinder-volume[81881]: INFO cinder.volume.manager [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 16:06:10 devstack cinder-volume[81881]: WARNING stevedore.named [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 16:06:10 devstack cinder-volume[81881]: WARNING castellan.key_manager [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 16:06:10 devstack cinder-volume[81881]: WARNING cinder.keymgr.conf_key_mgr [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 16:06:10 devstack cinder-volume[81881]: INFO cinder.volume.manager [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_db.sqlalchemy.engines [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81881) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:06:10 devstack cinder-volume[81881]: INFO oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Starting 1 workers Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Started child 82029 {{(pid=81881) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Full set of CONF: {{(pid=81881) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] ******************************************************************************** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Configuration options gathered from: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 16:06:10 devstack cinder-volume[82029]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] ================================================================================ {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] allow_availability_zone_fallback = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] allow_compression_on_image_upload = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] allowed_direct_url_schemes = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] api_rate_limit = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] auth_strategy = keystone {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_availability_zone = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_host = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_stats_polling_interval = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backup_api_class = cinder.backup.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backup_name_template = backup-%s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backup_use_same_host = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backup_use_temp_snapshot = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] chap_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] chap_username = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_internal_tenant_project_id = 6f9e99c63ebe43caac3f11f6159db4f1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_internal_tenant_user_id = de1716d0dfb242cca2c2ee55b19231a6 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cluster = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] compression_format = gzip {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] compute_api_class = cinder.compute.nova.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] config_dir = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] config_source = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] control_exchange = openstack {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] debug = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] default_availability_zone = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] default_group_type = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] default_volume_type = QuobyteHD {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] disk_geometry = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] driver_client_cert = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] driver_client_cert_key = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] driver_data_namespace = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] driver_ssl_cert_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] driver_ssl_cert_verify = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] driver_use_ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] enable_new_services = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] enable_unsupported_driver = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] enabled_backends = ['QuobyteHD'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] enforce_multipath_for_image_xfer = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] filter_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_api_insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_api_ssl_compression = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_ca_certificates_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[82029]: INFO cinder.volume.manager [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_catalog_info = image:glance:publicURL {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.remotefs [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82029) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_num_retries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance_request_timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] goodness_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] graceful_shutdown_timeout = 5 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] group_api_class = cinder.group.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] host = devstack {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_compress_on_upload = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_conversion_address_space_limit = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_conversion_cpu_limit = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_conversion_disable = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_upload_use_cinder_backend = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_upload_use_internal_tenant = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_volume_cache_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_volume_cache_max_count = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] image_volume_cache_max_size_gb = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] init_host_max_objects_retrieval = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] instance_format = [instance: %(uuid)s] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] iscsi_target_flags = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] iscsi_write_cache = on {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] iser_helper = tgtadm {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] iser_ip_address = 192.168.122.62 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] iser_port = 3260 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_color = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_config_append = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_dir = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_options = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_rotate_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_rotate_interval_type = days {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] log_rotation_type = none {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] max_age = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] max_logfile_count = 30 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] max_logfile_size_mb = 200 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] max_over_subscription_ratio = 20.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] message_reap_interval = 86400 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] message_ttl = 2592000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] migration_create_volume_timeout_secs = 300 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] monkey_patch = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] monkey_patch_modules = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] my_ip = 192.168.122.62 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] no_snapshot_gb_quota = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] num_iser_scan_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] num_shell_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] num_volume_device_scan_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] nvmeof_conn_info_version = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] nvmet_ns_id = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] nvmet_port_id = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] osapi_max_limit = 1000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] osapi_volume_ext_list = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] osapi_volume_listen = 0.0.0.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] osapi_volume_listen_port = 8776 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] osapi_volume_use_ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] osapi_volume_workers = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] per_volume_size_limit = -1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] periodic_fuzzy_delay = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] periodic_interval = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] project_id_regex = [0-9a-f\-]+ {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] public_endpoint = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] publish_errors = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] quota_backup_gigabytes = 1000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] quota_backups = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] quota_gigabytes = 1000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] quota_groups = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] quota_snapshots = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] quota_volumes = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] rate_limit_burst = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] rate_limit_except_level = CRITICAL {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] rate_limit_interval = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] reinit_driver_count = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] replication_device = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] report_discard_supported = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] report_interval = 120 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] reservation_clean_interval = 86400 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] reservation_expire = 86400 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] reserved_image_namespaces = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] reserved_percentage = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] rpc_response_timeout = 120 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] run_external_periodic_tasks = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] scst_target_driver = iscsi {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] scst_target_iqn_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_down_time = 720 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] shell_completion = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] snapshot_name_template = snapshot-%s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] state_path = /opt/stack/data/cinder {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] storage_availability_zone = nova {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] storage_protocol = iSCSI {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] syslog_log_facility = LOG_USER {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] target_helper = lioadm {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] target_ip_address = 192.168.122.62 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] target_port = 3260 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] target_protocol = iscsi {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] target_secondary_ip_addresses = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] trace_flags = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] transfer_api_class = cinder.transfer.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82029) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 16:06:10 devstack cinder-volume[82029]: WARNING cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 16:06:10 devstack cinder-volume[82029]: WARNING cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] transport_url = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] until_refresh = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] use_chap_auth = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] use_default_quota_class = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Running cmd (subprocess): mount.quobyte {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] use_journal = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] use_json = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] use_multipath_for_image_xfer = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] use_stderr = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] use_syslog = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] verify_glance_signatures = enabled {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_api_class = cinder.volume.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_backend_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_clear = zero {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_clear_ionice = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_clear_size = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_copy_bps_limit = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_dd_blocksize = 1M {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_name_template = volume-%s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_service_inithost_offload = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volume_usage_audit_period = month {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] zoning_mode = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_concurrency.disable_process_locking = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:10 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.admin_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.admin_token = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.admin_user = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.auth_admin_prefix = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.auth_port = 35357 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.auth_protocol = https {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.auth_section = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.auth_type = password {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.auth_uri = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.auth_version = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.cache = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.delay_auth_decision = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.http_connect_timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.identity_uri = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.include_service_catalog = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.interface = public {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_password = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcache_username = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.region_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.service_token_roles_required = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.service_type = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.token_cache_time = 300 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.backend = dogpile.cache.null {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.backend_argument = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.backend_expiration_time = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.config_prefix = cache.oslo {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.debug_cache_backend = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.enable_retry_client = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.enable_socket_keepalive = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.enforce_fips_mode = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.expiration_time = 600 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.hashclient_retry_attempts = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.memcache_dead_retry = 300 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.memcache_pool_maxsize = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.memcache_sasl_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.proxies = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.redis_db = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.redis_sentinel_service_name = mymaster {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.redis_server = localhost:6379 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.retry_attempts = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.retry_delay = 0.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.socket_keepalive_count = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.socket_keepalive_idle = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.socket_keepalive_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.socket_timeout = 1.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.tls_allowed_ciphers = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.tls_cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.tls_certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.tls_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.tls_keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cache.username = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] coordination.backend_url = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.asyncio_connection = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.asyncio_slave_connection = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.backend = sqlalchemy {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.connection = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.connection_debug = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.connection_parameters = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.connection_recycle_time = 3600 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.connection_trace = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack quobyte-client[82030]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 16:06:11 devstack quobyte-client[82030]: Invalid parameters found, error: missing mount point. Apr 15 16:06:11 devstack quobyte-client[82030]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 16:06:11 devstack quobyte-client[82030]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.db_inc_retry_interval = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.db_max_retries = 20 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.db_max_retry_interval = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.db_retry_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.max_overflow = 50 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.max_pool_size = 5 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.max_retries = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.mysql_wsrep_sync_wait = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.pool_timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.retry_interval = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.slave_connection = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.sqlite_synchronous = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.synchronous_reader = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] database.use_db_reconnect = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.connection_string = messaging:// {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.es_doc_type = notification {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.es_scroll_size = 10000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.es_scroll_time = 2m {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.filter_error_trace = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.hmac_keys = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.sentinel_service_name = mymaster {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.socket_timeout = 0.1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.trace_requests = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler.trace_sqlalchemy = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler_jaeger.process_tags = {} {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[82029]: INFO cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c ... Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler_jaeger.service_name_prefix = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 -c /etc/quobyte/client-cinder.cfg {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] profiler_otlp.service_name_prefix = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.enforce_new_defaults = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: WARNING oslo_config.cfg [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.enforce_scope = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.policy_default_rule = default {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.policy_file = policy.yaml {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_policy.remote_timeout = 60.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] privsep_osbrick.group = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] privsep_osbrick.helper_command = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] privsep_osbrick.user = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_sys_admin.group = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_sys_admin.helper_command = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] cinder_sys_admin.user = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.auth_section = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.auth_type = password {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.collect_timing = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack sudo[82031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 -c /etc/quobyte/client-cinder.cfg Apr 15 16:06:11 devstack sudo[82031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.send_service_user_token = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] service_user.timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.auth_section = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.auth_type = password {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.collect_timing = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.region_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] glance.timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.backend_availability_zone = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.chap_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.chap_username = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.disk_geometry = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.driver_client_cert = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.driver_client_cert_key = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.driver_data_namespace = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.driver_use_ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.enable_unsupported_driver = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.extra_capabilities = {} {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.filter_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.goodness_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.iscsi_target_flags = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.iscsi_write_cache = on {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.iser_helper = tgtadm {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.iser_port = 3260 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_host = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_login = admin {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_mount_options = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_private_key = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_share_path = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_ssh_port = 22 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.num_shell_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.nvmet_port_id = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.quobyte_client_cfg = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.quobyte_volume_url = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.replication_device = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.report_discard_supported = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.reserved_percentage = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.scst_target_driver = iscsi {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.scst_target_iqn_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.storage_protocol = iSCSI {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.target_helper = tgtadm {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.target_port = 3260 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.target_protocol = iscsi {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.trace_flags = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.unique_fqdn_network = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.use_chap_auth = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volume_backend_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volume_clear = zero {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volume_clear_ionice = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volume_clear_size = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_reports.file_event_handler = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_reports.log_dir = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.backend_availability_zone = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.backend_host = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.chap_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.chap_username = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.chiscsi_conf = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.disk_geometry = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.driver_client_cert = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.driver_client_cert_key = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.driver_data_namespace = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.driver_use_ssl = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.extra_capabilities = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.filter_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.goodness_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.iscsi_target_flags = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.iscsi_write_cache = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.iser_helper = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.iser_ip_address = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.iser_port = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.iser_target_prefix = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_host = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_login = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_mount_options = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_private_key = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_share_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_ssh_port = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.num_shell_tries = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nvmet_ns_id = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.nvmet_port_id = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.replication_device = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.report_discard_supported = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.reserved_percentage = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.scst_target_driver = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.storage_protocol = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.target_helper = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.target_ip_address = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.target_port = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.target_prefix = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.target_protocol = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.trace_flags = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.unique_fqdn_network = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.use_chap_auth = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volume_clear = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volume_clear_ionice = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volume_clear_size = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] QuobyteHD.volumes_dir = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.ssl_version = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_notifications.driver = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_notifications.retry = -1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] oslo_messaging_notifications.transport_url = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] key_manager.fixed_key = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.barbican_api_version = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.barbican_endpoint = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.barbican_endpoint_type = public {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.barbican_region_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.collect_timing = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.number_of_retries = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.retry_delay = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.send_service_user_token = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.verify_ssl = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican.verify_ssl_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.auth_section = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.auth_type = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.collect_timing = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] barbican_service_user.timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.approle_role_id = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.approle_secret_id = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.kv_mountpoint = secret {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.kv_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.kv_version = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.namespace = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.root_token_id = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.ssl_ca_crt_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.timeout = 60.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.use_ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:11 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] ******************************************************************************** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 16:06:11 devstack sudo[82031]: pam_unix(sudo:session): session closed for user root Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.497s {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:11 devstack cinder-volume[82029]: INFO cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c succeeded Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.503s {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:11 devstack sudo[82101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:06:11 devstack sudo[82101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:06:11 devstack sudo[82101]: pam_unix(sudo:session): session closed for user root Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.410s {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:11 devstack cinder-volume[82029]: INFO cinder.volume.driver [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Driver hasn't implemented _init_vendor_properties() Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG cinder.volume.driver [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7265129089355, 'free_capacity_gb': 1775.7265129089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82029) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 16:06:11 devstack cinder-volume[82029]: DEBUG oslo_db.sqlalchemy.engines [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG dbcounter [-] [82029] Writer thread running {{(pid=82029) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.db.sqlalchemy.api [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Building query based on filter {{(pid=82029) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.image.image_utils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82029) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 16:06:12 devstack cinder-volume[82029]: INFO cinder.keymgr.migration [None req-a784e36f-048d-4b3b-b9ae-aff4fbdc2b0d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:12 devstack sudo[82104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:06:12 devstack sudo[82104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:06:12 devstack sudo[82104]: pam_unix(sudo:session): session closed for user root Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.393s {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.manager [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Notifying Schedulers of capabilities ... {{(pid=82029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:06:12 devstack cinder-volume[82029]: INFO cinder.volume.manager [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Driver initialization completed successfully. Apr 15 16:06:12 devstack cinder-volume[82029]: INFO cinder.manager [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Initiating service 3 cleanup Apr 15 16:06:12 devstack cinder-volume[82029]: INFO cinder.manager [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Service 3 cleanup completed. Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.service [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Creating RPC server for service cinder-volume {{(pid=82029) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.service [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82029) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 16:06:12 devstack cinder-volume[82029]: INFO cinder.volume.manager [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:12 devstack sudo[82109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:06:12 devstack sudo[82109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:06:12 devstack sudo[82109]: pam_unix(sudo:session): session closed for user root Apr 15 16:06:12 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.453s {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:12 devstack cinder-volume[82029]: INFO cinder.volume.manager [None req-b1238417-c023-44d0-8717-552e2a3ffadb None None] Driver post RPC initialization completed successfully. Apr 15 16:06:16 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-6c4c26d1-150a-4110-b14d-e5cf1b456cb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:06:16 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-6c4c26d1-150a-4110-b14d-e5cf1b456cb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:06:16 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-6c4c26d1-150a-4110-b14d-e5cf1b456cb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:06:16 devstack cinder-volume[82029]: DEBUG cinder.volume.drivers.quobyte [None req-6c4c26d1-150a-4110-b14d-e5cf1b456cb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:06:16 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-6c4c26d1-150a-4110-b14d-e5cf1b456cb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82029) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:06:16 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-6c4c26d1-150a-4110-b14d-e5cf1b456cb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:16 devstack sudo[82176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:06:16 devstack sudo[82176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:06:16 devstack sudo[82176]: pam_unix(sudo:session): session closed for user root Apr 15 16:06:16 devstack cinder-volume[82029]: DEBUG oslo_concurrency.processutils [None req-6c4c26d1-150a-4110-b14d-e5cf1b456cb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.389s {{(pid=82029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:16 devstack cinder-volume[82029]: DEBUG cinder.manager [None req-6c4c26d1-150a-4110-b14d-e5cf1b456cb3 None None] Notifying Schedulers of capabilities ... {{(pid=82029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:06:19 devstack cinder-volume[81881]: INFO oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Caught SIGTERM, stopping children Apr 15 16:06:19 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Acquiring lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 16:06:19 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Acquired lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 16:06:19 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Releasing lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 16:06:19 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Stop services. {{(pid=81881) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 16:06:19 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Killing children. {{(pid=81881) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 16:06:19 devstack cinder-volume[81881]: INFO oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Waiting on 1 children to exit Apr 15 16:06:20 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Acquiring lock "singleton_lock" {{(pid=82029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 16:06:20 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Acquired lock "singleton_lock" {{(pid=82029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 16:06:20 devstack cinder-volume[82029]: DEBUG oslo_concurrency.lockutils [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Releasing lock "singleton_lock" {{(pid=82029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 16:06:20 devstack cinder-volume[82029]: WARNING amqp [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 16:06:20 devstack cinder-volume[82029]: WARNING amqp [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 16:06:20 devstack cinder-volume[81881]: INFO oslo_service.backend._eventlet.service [None req-ebc6a688-459e-4297-b06d-6b09cd3c1eeb None None] Child 82029 exited with status 0 Apr 15 16:06:20 devstack cinder-volume[82250]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 16:06:20 devstack cinder-volume[82250]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 16:06:20 devstack cinder-volume[82250]: we strongly recommend against using it for new projects. Apr 15 16:06:20 devstack cinder-volume[82250]: If you are already using Eventlet, we recommend migrating to a different Apr 15 16:06:20 devstack cinder-volume[82250]: framework. For more detail see Apr 15 16:06:20 devstack cinder-volume[82250]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 16:06:20 devstack cinder-volume[82250]: import eventlet # noqa Apr 15 16:06:22 devstack cinder-volume[82250]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82250) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 16:06:22 devstack cinder-volume[82250]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82250) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 16:06:22 devstack cinder-volume[82250]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82250) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 16:06:23 devstack cinder-volume[82250]: INFO dbcounter [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Registered counter for database cinder Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_db.sqlalchemy.engines [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82250) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG dbcounter [-] [82250] Writer thread running {{(pid=82250) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 16:06:23 devstack cinder-volume[82250]: INFO cinder.rpc [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 16:06:23 devstack cinder-volume[82250]: INFO cinder.rpc [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_db.sqlalchemy.engines [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82250) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:06:23 devstack cinder-volume[82250]: INFO cinder.volume.manager [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Determined volume DB was empty at startup. Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG cinder.volume.manager [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82250) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 16:06:23 devstack cinder-volume[82250]: WARNING stevedore.named [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 16:06:23 devstack cinder-volume[82250]: WARNING castellan.key_manager [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 16:06:23 devstack cinder-volume[82250]: WARNING cinder.keymgr.conf_key_mgr [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 16:06:23 devstack cinder-volume[82250]: INFO cinder.volume.manager [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_db.sqlalchemy.engines [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82250) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:06:23 devstack cinder-volume[82250]: INFO oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Starting 1 workers Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Started child 82392 {{(pid=82250) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Full set of CONF: {{(pid=82250) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] ******************************************************************************** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Configuration options gathered from: {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] ================================================================================ {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] allow_availability_zone_fallback = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] allow_compression_on_image_upload = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] allowed_direct_url_schemes = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] api_rate_limit = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] auth_strategy = keystone {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_availability_zone = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_host = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_stats_polling_interval = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backup_api_class = cinder.backup.api.API {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backup_name_template = backup-%s {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backup_use_same_host = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backup_use_temp_snapshot = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] chap_password = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] chap_username = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_internal_tenant_project_id = 6f9e99c63ebe43caac3f11f6159db4f1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_internal_tenant_user_id = de1716d0dfb242cca2c2ee55b19231a6 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cluster = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] compression_format = gzip {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] compute_api_class = cinder.compute.nova.API {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] config_dir = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] config_source = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] control_exchange = openstack {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] debug = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] default_availability_zone = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] default_group_type = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] default_volume_type = QuobyteHD {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] disk_geometry = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] driver_client_cert = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] driver_client_cert_key = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] driver_data_namespace = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] driver_ssl_cert_path = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] driver_ssl_cert_verify = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82392]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] driver_use_ssl = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] enable_new_services = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] enable_unsupported_driver = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] enabled_backends = ['QuobyteHD'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] enforce_multipath_for_image_xfer = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] filter_function = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_api_insecure = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_api_ssl_compression = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_ca_certificates_file = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_catalog_info = image:glance:publicURL {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_certfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_keyfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_num_retries = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance_request_timeout = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] goodness_function = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] graceful_shutdown_timeout = 5 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] group_api_class = cinder.group.api.API {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] host = devstack {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_compress_on_upload = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_conversion_address_space_limit = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_conversion_cpu_limit = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_conversion_disable = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_upload_use_cinder_backend = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_upload_use_internal_tenant = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_volume_cache_enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_volume_cache_max_count = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] image_volume_cache_max_size_gb = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] init_host_max_objects_retrieval = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] instance_format = [instance: %(uuid)s] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] iscsi_target_flags = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] iscsi_write_cache = on {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] iser_helper = tgtadm {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] iser_ip_address = 192.168.122.62 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] iser_port = 3260 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_color = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_config_append = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_dir = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82392) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_file = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_options = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_rotate_interval = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_rotate_interval_type = days {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] log_rotation_type = none {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] max_age = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] max_logfile_count = 30 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] max_logfile_size_mb = 200 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] max_over_subscription_ratio = 20.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] message_reap_interval = 86400 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] message_ttl = 2592000 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] migration_create_volume_timeout_secs = 300 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] monkey_patch = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] monkey_patch_modules = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] my_ip = 192.168.122.62 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] no_snapshot_gb_quota = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] num_iser_scan_tries = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] num_shell_tries = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] num_volume_device_scan_tries = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] nvmeof_conn_info_version = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] nvmet_ns_id = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] nvmet_port_id = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] osapi_max_limit = 1000 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] osapi_volume_ext_list = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] osapi_volume_listen_port = 8776 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] osapi_volume_use_ssl = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] osapi_volume_workers = 2 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] per_volume_size_limit = -1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] periodic_fuzzy_delay = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82392) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 16:06:23 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 16:06:23 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] periodic_interval = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] public_endpoint = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] publish_errors = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] quota_backup_gigabytes = 1000 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] quota_backups = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] quota_gigabytes = 1000 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] quota_groups = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] quota_snapshots = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] quota_volumes = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Running cmd (subprocess): mount.quobyte {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] rate_limit_burst = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] rate_limit_except_level = CRITICAL {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:23 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] rate_limit_interval = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] reinit_driver_count = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] replication_device = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] report_discard_supported = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] report_interval = 120 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] reservation_clean_interval = 86400 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] reservation_expire = 86400 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] reserved_image_namespaces = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] reserved_percentage = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] rpc_response_timeout = 120 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] run_external_periodic_tasks = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] scst_target_driver = iscsi {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] scst_target_iqn_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_down_time = 720 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] shell_completion = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] snapshot_name_template = snapshot-%s {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] split_loggers = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] state_path = /opt/stack/data/cinder {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] storage_availability_zone = nova {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] storage_protocol = iSCSI {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] syslog_log_facility = LOG_USER {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] target_helper = lioadm {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] target_ip_address = 192.168.122.62 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] target_port = 3260 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] target_protocol = iscsi {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] target_secondary_ip_addresses = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] trace_flags = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] transport_url = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] until_refresh = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] use_chap_auth = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] use_default_quota_class = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] use_journal = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] use_json = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] use_multipath_for_image_xfer = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] use_stderr = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] use_syslog = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] verify_glance_signatures = enabled {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_api_class = cinder.volume.api.API {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_backend_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_clear = zero {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_clear_ionice = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_clear_size = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_copy_bps_limit = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_dd_blocksize = 1M {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_name_template = volume-%s {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_service_inithost_offload = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volume_usage_audit_period = month {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] zoning_mode = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.admin_password = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.admin_token = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.admin_user = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.auth_port = 35357 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.auth_protocol = https {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.auth_section = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.auth_type = password {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.auth_uri = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.auth_version = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.cache = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.certfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.identity_uri = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.include_service_catalog = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.insecure = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.interface = public {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.keyfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_password = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack quobyte-client[82397]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 16:06:24 devstack quobyte-client[82397]: Invalid parameters found, error: missing mount point. Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack quobyte-client[82397]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcache_username = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.region_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack quobyte-client[82397]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.service_type = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.backend = dogpile.cache.null {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.backend_argument = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.backend_expiration_time = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.config_prefix = cache.oslo {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.debug_cache_backend = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.enable_retry_client = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.enable_socket_keepalive = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] CMD "mount.quobyte" returned: 1 in 0.281s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.enforce_fips_mode = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.expiration_time = 600 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.hashclient_retry_attempts = 2 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.memcache_dead_retry = 300 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.memcache_pool_maxsize = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.memcache_sasl_enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.password = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.proxies = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.redis_db = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.redis_server = localhost:6379 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.retry_attempts = 2 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.retry_delay = 0.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.socket_keepalive_count = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.socket_keepalive_idle = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.socket_keepalive_interval = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.socket_timeout = 1.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.tls_allowed_ciphers = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.tls_cafile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.tls_certfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.tls_enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.tls_keyfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cache.username = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] coordination.backend_url = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.asyncio_connection = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.asyncio_slave_connection = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.backend = sqlalchemy {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.connection = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.connection_debug = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.connection_parameters = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.connection_recycle_time = 3600 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.connection_trace = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.db_inc_retry_interval = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.db_max_retries = 20 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.db_max_retry_interval = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.db_retry_interval = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.max_overflow = 50 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.max_pool_size = 5 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.max_retries = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.mysql_wsrep_sync_wait = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack sudo[82432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:06:24 devstack sudo[82432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.pool_timeout = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.retry_interval = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.slave_connection = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.sqlite_synchronous = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.synchronous_reader = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] database.use_db_reconnect = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.connection_string = messaging:// {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.es_doc_type = notification {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.es_scroll_size = 10000 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.es_scroll_time = 2m {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.filter_error_trace = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.hmac_keys = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.sentinel_service_name = mymaster {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.socket_timeout = 0.1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.trace_requests = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler.trace_sqlalchemy = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler_jaeger.process_tags = {} {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler_jaeger.service_name_prefix = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] profiler_otlp.service_name_prefix = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.enforce_new_defaults = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: WARNING oslo_config.cfg [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.enforce_scope = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.policy_default_rule = default {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.policy_file = policy.yaml {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] privsep_osbrick.group = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] privsep_osbrick.helper_command = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] privsep_osbrick.user = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_sys_admin.group = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_sys_admin.helper_command = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] cinder_sys_admin.user = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.auth_section = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.auth_type = password {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.cafile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.certfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.collect_timing = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.insecure = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.keyfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.send_service_user_token = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.split_loggers = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] service_user.timeout = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.auth_section = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.auth_type = password {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.certfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.collect_timing = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.insecure = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.keyfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.region_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.split_loggers = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] glance.timeout = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.backend_availability_zone = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.chap_password = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.chap_username = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.disk_geometry = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.driver_client_cert = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.driver_client_cert_key = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.driver_data_namespace = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.driver_use_ssl = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.extra_capabilities = {} {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.filter_function = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.goodness_function = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.iscsi_target_flags = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.iscsi_write_cache = on {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.iser_helper = tgtadm {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.iser_port = 3260 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_host = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_login = admin {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_mount_options = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_password = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_private_key = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_share_path = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.num_shell_tries = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.quobyte_volume_url = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.replication_device = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.report_discard_supported = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.reserved_percentage = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.target_helper = tgtadm {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.target_port = 3260 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.target_protocol = iscsi {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.trace_flags = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.unique_fqdn_network = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.use_chap_auth = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volume_backend_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volume_clear = zero {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volume_clear_ionice = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volume_clear_size = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_reports.file_event_handler = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_reports.log_dir = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.backend_availability_zone = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.backend_host = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.chap_password = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.chap_username = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.chiscsi_conf = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.disk_geometry = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.driver_client_cert = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.driver_data_namespace = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.driver_use_ssl = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.extra_capabilities = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.filter_function = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.goodness_function = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.iser_helper = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.iser_ip_address = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.iser_port = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.iser_target_prefix = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_host = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_login = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_mount_options = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_password = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_private_key = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_share_path = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_ssh_port = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.num_shell_tries = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.nvmet_port_id = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.replication_device = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.report_discard_supported = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.reserved_percentage = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.scst_target_driver = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.storage_protocol = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.target_helper = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.target_ip_address = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.target_port = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.target_prefix = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.target_protocol = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.trace_flags = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.use_chap_auth = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volume_clear = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volume_clear_size = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] QuobyteHD.volumes_dir = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.ssl = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_notifications.driver = [] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] key_manager.fixed_key = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.barbican_api_version = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.barbican_endpoint = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.barbican_endpoint_type = public {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.barbican_region_name = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.cafile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.certfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.collect_timing = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.insecure = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.keyfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.number_of_retries = 60 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.retry_delay = 1 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.send_service_user_token = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.split_loggers = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.timeout = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.verify_ssl = True {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican.verify_ssl_path = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.auth_section = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.auth_type = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.cafile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.certfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.collect_timing = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.insecure = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.keyfile = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.split_loggers = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] barbican_service_user.timeout = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.approle_role_id = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.approle_secret_id = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.kv_mountpoint = secret {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.kv_path = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.kv_version = 2 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.namespace = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.root_token_id = **** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.ssl_ca_crt_file = None {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.timeout = 60.0 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.use_ssl = False {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 16:06:24 devstack cinder-volume[82250]: DEBUG oslo_service.backend._eventlet.service [None req-6f5697bd-64e2-44b1-8ea8-3afb277089c6 None None] ******************************************************************************** {{(pid=82250) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 16:06:24 devstack sudo[82432]: pam_unix(sudo:session): session closed for user root Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.579s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:24 devstack cinder-volume[82392]: INFO cinder.volume.driver [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Driver hasn't implemented _init_vendor_properties() Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG cinder.volume.driver [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7265129089355, 'free_capacity_gb': 1775.7265129089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82392) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_db.sqlalchemy.engines [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82392) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writer thread running {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG cinder.db.sqlalchemy.api [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Building query based on filter {{(pid=82392) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82392) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:06:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:24 devstack cinder-volume[82392]: INFO cinder.keymgr.migration [None req-c0c2ec9d-b62f-4718-9d77-1a4aff2e7daf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 16:06:24 devstack sudo[82481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:06:24 devstack sudo[82481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:06:25 devstack sudo[82481]: pam_unix(sudo:session): session closed for user root Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.519s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:06:25 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Driver initialization completed successfully. Apr 15 16:06:25 devstack cinder-volume[82392]: INFO cinder.manager [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Initiating service 3 cleanup Apr 15 16:06:25 devstack cinder-volume[82392]: INFO cinder.manager [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Service 3 cleanup completed. Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG cinder.service [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Creating RPC server for service cinder-volume {{(pid=82392) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG cinder.service [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82392) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 16:06:25 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:06:25 devstack sudo[82498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:06:25 devstack sudo[82498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:06:25 devstack sudo[82498]: pam_unix(sudo:session): session closed for user root Apr 15 16:06:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.390s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:06:25 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1b9268d3-df5e-43b9-a364-b74d7912f89e None None] Driver post RPC initialization completed successfully. Apr 15 16:06:33 devstack cinder-volume[82250]: DEBUG dbcounter [-] [82250] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82250) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:06:35 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=1 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:06:35 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Flow 'volume_create_manager' (abe26670-1091-4f29-bad9-456fd973ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c61fb8-ca5e-431e-801e-1c40c9bcada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c61fb8-ca5e-431e-801e-1c40c9bcada1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-830169496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996f2f63-a0df-48b2-88a1-d7316c6f9c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd9a50631a94cf7a3471ff5b6cfa64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:07:25Z,use_quota=True,user_id='7feab910b30c4a51a088e4a8b10a8818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f856a0fc-5695-46f0-9c39-f55b1d1cd35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f856a0fc-5695-46f0-9c39-f55b1d1cd35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ddab7a0-1006-4170-87a9-29c59811ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ddab7a0-1006-4170-87a9-29c59811ef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '996f2f63-a0df-48b2-88a1-d7316c6f9c05', 'volume_name': 'volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724b44bd-3f69-4a77-aa92-c0a725e57375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724b44bd-3f69-4a77-aa92-c0a725e57375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ae63a2-ee9f-4ec6-a858-c0e56e398d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Volume 996f2f63-a0df-48b2-88a1-d7316c6f9c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05', 'volume_size': 1} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-830169496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996f2f63-a0df-48b2-88a1-d7316c6f9c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd9a50631a94cf7a3471ff5b6cfa64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:07:25Z,use_quota=True,user_id='7feab910b30c4a51a088e4a8b10a8818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Creating volume 996f2f63-a0df-48b2-88a1-d7316c6f9c05 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:07:25 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:07:25 devstack sudo[82920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 1073741824 Apr 15 16:07:25 devstack sudo[82920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Flow 'volume_create_manager' (2e495f0e-25e9-403c-b62b-b00869c417ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d06d25-1134-450f-b2dd-35ee1912df11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d06d25-1134-450f-b2dd-35ee1912df11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-87521129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17dcd6a-87f9-4901-b7ca-babbbfea427b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eee78f6a77441d2a53dd5319938edd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:07:26Z,use_quota=True,user_id='c9e7b8cd95474ecfb2032281a7382ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8364c2a3-3282-4c48-b380-d383e23b3b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8364c2a3-3282-4c48-b380-d383e23b3b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac2cd4b-3415-41c4-a463-ff1d8c649c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac2cd4b-3415-41c4-a463-ff1d8c649c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17dcd6a-87f9-4901-b7ca-babbbfea427b', 'volume_name': 'volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469ecd89-d03c-471d-8fdb-bbc5e74d51b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469ecd89-d03c-471d-8fdb-bbc5e74d51b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539173ae-d4c1-49ee-a1ba-4cb6db6d1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:25 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Volume a17dcd6a-87f9-4901-b7ca-babbbfea427b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b', 'volume_size': 1} Apr 15 16:07:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:26 devstack sudo[82920]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 1073741824" returned: 0 in 1.255s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:27 devstack sudo[83240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 Apr 15 16:07:27 devstack sudo[83240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:27 devstack sudo[83240]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05" returned: 0 in 0.675s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-87521129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17dcd6a-87f9-4901-b7ca-babbbfea427b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eee78f6a77441d2a53dd5319938edd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:07:26Z,use_quota=True,user_id='c9e7b8cd95474ecfb2032281a7382ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Creating volume a17dcd6a-87f9-4901-b7ca-babbbfea427b {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:07:27 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ae63a2-ee9f-4ec6-a858-c0e56e398d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d95fc2-2e8a-430e-b0c4-5e5429e8c3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:27 devstack sudo[83247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b 1073741824 Apr 15 16:07:27 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Volume volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 (996f2f63-a0df-48b2-88a1-d7316c6f9c05): created successfully Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d95fc2-2e8a-430e-b0c4-5e5429e8c3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:27 devstack sudo[83247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:27 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Flow 'volume_create_manager' (abe26670-1091-4f29-bad9-456fd973ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:07:27 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e22b214e-1baa-4282-b00a-b4b293195a5c tempest-VolumesServicesTestJSON-1781089459 None] Created volume successfully. Apr 15 16:07:28 devstack sudo[83247]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b 1073741824" returned: 0 in 0.622s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:28 devstack sudo[83256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b Apr 15 16:07:28 devstack sudo[83256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Acquiring lock "cinder-996f2f63-a0df-48b2-88a1-d7316c6f9c05-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:07:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Lock "cinder-996f2f63-a0df-48b2-88a1-d7316c6f9c05-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:07:28 devstack sudo[83256]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b" returned: 0 in 0.614s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:07:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539173ae-d4c1-49ee-a1ba-4cb6db6d1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7d90e7-07be-4b51-8efd-50a062567b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Acquiring lock "cinder-quobyte-996f2f63-a0df-48b2-88a1-d7316c6f9c05" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:07:29 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Volume volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b (a17dcd6a-87f9-4901-b7ca-babbbfea427b): created successfully Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7d90e7-07be-4b51-8efd-50a062567b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Flow 'volume_create_manager' (2e495f0e-25e9-403c-b62b-b00869c417ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Lock "cinder-quobyte-996f2f63-a0df-48b2-88a1-d7316c6f9c05" acquired by "delete_volume" :: waited 0.028s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:07:29 devstack cinder-volume[82392]: INFO oslo.privsep.daemon [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb5qe5okd/privsep.sock'] Apr 15 16:07:29 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c27b082c-e5be-46be-b13a-46ee9f2992ad tempest-VolumesAdminNegativeTest-2089775121 None] Created volume successfully. Apr 15 16:07:29 devstack sudo[83266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb5qe5okd/privsep.sock Apr 15 16:07:29 devstack sudo[83266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 16:07:29 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Acquiring lock "cinder-a17dcd6a-87f9-4901-b7ca-babbbfea427b-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "cinder-a17dcd6a-87f9-4901-b7ca-babbbfea427b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Acquiring lock "cinder-quobyte-a17dcd6a-87f9-4901-b7ca-babbbfea427b" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:07:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "cinder-quobyte-a17dcd6a-87f9-4901-b7ca-babbbfea427b" acquired by "delete_volume" :: waited 0.030s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 16:07:30 devstack sudo[83266]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:30 devstack cinder-volume[82392]: INFO oslo.privsep.daemon [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Spawned new privsep daemon via rootwrap Apr 15 16:07:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Accepted privsep connection to /tmp/tmpb5qe5okd/privsep.sock {{(pid=82392) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 16:07:30 devstack cinder-volume[82392]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 16:07:30 devstack cinder-volume[82392]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 16:07:30 devstack cinder-volume[82392]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 16:07:30 devstack cinder-volume[82392]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83276 Apr 15 16:07:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb1857e-6e88-46b2-8521-597555f08db9]: (2,) {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:07:30 devstack cinder-volume[82392]: WARNING oslo_privsep.priv_context [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] privsep daemon already running Apr 15 16:07:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd45bd54-0ab9-4494-8501-2d3ffc4a8dee]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:07:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ef2065-e389-4481-a000-a06f47d87b5a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:07:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:30 devstack sudo[83280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 Apr 15 16:07:30 devstack sudo[83280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:30 devstack sudo[83279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b Apr 15 16:07:30 devstack sudo[83279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:31 devstack sudo[83279]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b" returned: 0 in 0.708s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:31 devstack sudo[83280]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05" returned: 0 in 0.728s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:31 devstack sudo[83290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b Apr 15 16:07:31 devstack sudo[83290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:31 devstack sudo[83291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05 Apr 15 16:07:31 devstack sudo[83291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:32 devstack sudo[83291]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-996f2f63-a0df-48b2-88a1-d7316c6f9c05" returned: 0 in 0.733s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Lock "cinder-quobyte-996f2f63-a0df-48b2-88a1-d7316c6f9c05" released by "delete_volume" :: held 3.144s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:07:32 devstack sudo[83290]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a17dcd6a-87f9-4901-b7ca-babbbfea427b" returned: 0 in 0.882s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "cinder-quobyte-a17dcd6a-87f9-4901-b7ca-babbbfea427b" released by "delete_volume" :: held 2.481s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:07:32 devstack cinder-volume[82392]: WARNING cinder.quota [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:07:32 devstack cinder-volume[82392]: WARNING cinder.quota [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Created reservations ['ca72fdb8-eb6f-42ab-ac42-26109a15a3cc', 'd5f63be9-dc04-4926-9f55-86a5a0f8b7f8', '349583b2-f027-4896-9669-cedd64513fdd', 'd4847f11-4371-46f9-ac22-1a85c007f9ef'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Created reservations ['1e62bd3a-8da6-4be5-9f60-2d30e5752e51', '450ac68d-496b-4f13-af2d-666fe28e6097', 'e9ae7480-c5ab-4b63-9786-97432ac92064', '2e6b8708-21dd-4ecd-a15b-db630913ef90'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:07:32 devstack sudo[83304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:32 devstack sudo[83304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:32 devstack sudo[83308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:07:32 devstack sudo[83308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:33 devstack sudo[83304]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.136s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:33 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:07:33 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Deleted volume successfully. Apr 15 16:07:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-deeabfcf-c953-413b-8830-2610f86ffd86 tempest-VolumesServicesTestJSON-1781089459 None] Lock "cinder-996f2f63-a0df-48b2-88a1-d7316c6f9c05-delete_volume" released by "delete_volume" :: held 4.854s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:07:34 devstack sudo[83308]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.794s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:34 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:07:34 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Deleted volume successfully. Apr 15 16:07:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3dc2c74-bd09-45af-a4ad-68ae693047ad tempest-VolumesAdminNegativeTest-2089775121 None] Lock "cinder-a17dcd6a-87f9-4901-b7ca-babbbfea427b-delete_volume" released by "delete_volume" :: held 4.736s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Flow 'volume_create_manager' (5a3e3f35-7c6e-4af7-afa4-5c4bca2697f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa408a6-88d6-41f8-9de5-dff94ccf9d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa408a6-88d6-41f8-9de5-dff94ccf9d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:07:36Z,deleted=False,deleted_at=None,display_description='',display_name='05b3545a-c325-4379-babd-6cff02d917d2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596f5e60-fa2d-40cc-ab0a-a4311a38023a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f1639bcc7144cca70cbf3397a66dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:07:36Z,use_quota=True,user_id='47ac8e86582a4af796155d03fc825783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501586b0-6291-43a5-ab82-41e32f3a1a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501586b0-6291-43a5-ab82-41e32f3a1a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9185ccfd-6e94-4e0d-9a52-704c1b8cf964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9185ccfd-6e94-4e0d-9a52-704c1b8cf964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596f5e60-fa2d-40cc-ab0a-a4311a38023a', 'volume_name': 'volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc38254c-edea-43ee-a348-61574e1aa0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc38254c-edea-43ee-a348-61574e1aa0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a18f0b-a573-4804-a243-685fb5fe1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:36 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Volume 596f5e60-fa2d-40cc-ab0a-a4311a38023a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a', 'volume_size': 1} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:07:36Z,deleted=False,deleted_at=None,display_description='',display_name='05b3545a-c325-4379-babd-6cff02d917d2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596f5e60-fa2d-40cc-ab0a-a4311a38023a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f1639bcc7144cca70cbf3397a66dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:07:36Z,use_quota=True,user_id='47ac8e86582a4af796155d03fc825783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Creating volume 596f5e60-fa2d-40cc-ab0a-a4311a38023a {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:07:36 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:07:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:36 devstack sudo[83365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a 1073741824 Apr 15 16:07:36 devstack sudo[83365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:37 devstack sudo[83365]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a 1073741824" returned: 0 in 0.722s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:37 devstack sudo[83372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a Apr 15 16:07:37 devstack sudo[83372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:37 devstack sudo[83372]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a" returned: 0 in 0.594s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a18f0b-a573-4804-a243-685fb5fe1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba571412-ee0e-4156-92d9-16cf03f5398f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:37 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Volume volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a (596f5e60-fa2d-40cc-ab0a-a4311a38023a): created successfully Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba571412-ee0e-4156-92d9-16cf03f5398f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Flow 'volume_create_manager' (5a3e3f35-7c6e-4af7-afa4-5c4bca2697f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:07:37 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-2925a01a-36a7-437a-9c9b-50ffd1109927 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Created volume successfully. Apr 15 16:07:41 devstack cinder-volume[82392]: WARNING py.warnings [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-c7e937d9-3692-478a-baaa-76a6c393c92f tempest-ServerBootFromVolumeStableRescueTest-575179876 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 15 16:07:41 devstack cinder-volume[82392]: .first() Apr 15 16:07:41 devstack cinder-volume[82392]: Apr 15 16:07:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-c7e937d9-3692-478a-baaa-76a6c393c92f tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-c7e937d9-3692-478a-baaa-76a6c393c92f tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:41 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e100ca-2b11-4db3-aa32-0221c77e7099]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:07:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-c7e937d9-3692-478a-baaa-76a6c393c92f tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:41 devstack sudo[83462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a Apr 15 16:07:41 devstack sudo[83462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:42 devstack sudo[83462]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-c7e937d9-3692-478a-baaa-76a6c393c92f tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a" returned: 0 in 0.938s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-c7e937d9-3692-478a-baaa-76a6c393c92f tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-c7e937d9-3692-478a-baaa-76a6c393c92f tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c', 'name': 'volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '711308e7-17b4-4071-ba4f-060f2642eb3c', 'enforce_multipath': True} {{(pid=82392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 16:07:42 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-26b0cda0-2a40-41ae-a44e-46c4cabe1034 req-c7e937d9-3692-478a-baaa-76a6c393c92f tempest-ServerBootFromVolumeStableRescueTest-575179876 None] attachment_update completed successfully. Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Flow 'volume_create_manager' (4dba6bc1-ff3a-48ba-8780-40bb3da28b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5461a4c9-d668-4317-8195-0d6cbce95ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5461a4c9-d668-4317-8195-0d6cbce95ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1428065859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd496cde-f0c7-4aee-aaf3-6dcc5607f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58640c8bfbba481587f6cee7fa4a2057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:07:45Z,use_quota=True,user_id='4109716ab0544803b518227d4670d6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4430250-e37c-4fa2-b17e-1660e5651dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4430250-e37c-4fa2-b17e-1660e5651dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be537905-1f21-4e28-b262-cadf79bf6ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be537905-1f21-4e28-b262-cadf79bf6ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd496cde-f0c7-4aee-aaf3-6dcc5607f109', 'volume_name': 'volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd67b95-fe0f-4514-8279-6658f39f7cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd67b95-fe0f-4514-8279-6658f39f7cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee8dfbf-bf60-4d15-803b-d59acbad0235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:44 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Volume cd496cde-f0c7-4aee-aaf3-6dcc5607f109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109', 'volume_size': 1} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1428065859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd496cde-f0c7-4aee-aaf3-6dcc5607f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58640c8bfbba481587f6cee7fa4a2057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:07:45Z,use_quota=True,user_id='4109716ab0544803b518227d4670d6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Creating volume cd496cde-f0c7-4aee-aaf3-6dcc5607f109 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:07:44 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:07:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:45 devstack sudo[83478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 1073741824 Apr 15 16:07:45 devstack sudo[83478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:46 devstack sudo[83478]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 1073741824" returned: 0 in 1.045s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:46 devstack sudo[83584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 Apr 15 16:07:46 devstack sudo[83584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:46 devstack sudo[83584]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109" returned: 0 in 0.835s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee8dfbf-bf60-4d15-803b-d59acbad0235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dba0d8-f043-4e3c-b2b9-6c098edafd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:07:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Volume volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 (cd496cde-f0c7-4aee-aaf3-6dcc5607f109): created successfully Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dba0d8-f043-4e3c-b2b9-6c098edafd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:07:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Flow 'volume_create_manager' (4dba6bc1-ff3a-48ba-8780-40bb3da28b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:07:47 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-44f72544-2bcc-455c-9666-75644c3ea3dc tempest-DeleteServersTestJSON-1687130349 None] Created volume successfully. Apr 15 16:07:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-d891f649-d919-4795-8a26-952f096b85da req-4472bb88-458b-4287-b9c3-1f312f45f0c6 tempest-DeleteServersTestJSON-1687130349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:07:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-d891f649-d919-4795-8a26-952f096b85da req-4472bb88-458b-4287-b9c3-1f312f45f0c6 tempest-DeleteServersTestJSON-1687130349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:07:52 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478266c-f85d-4781-b30d-87c8789b5b15]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:07:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-d891f649-d919-4795-8a26-952f096b85da req-4472bb88-458b-4287-b9c3-1f312f45f0c6 tempest-DeleteServersTestJSON-1687130349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:07:52 devstack sudo[83951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 Apr 15 16:07:52 devstack sudo[83951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:07:53 devstack sudo[83951]: pam_unix(sudo:session): session closed for user root Apr 15 16:07:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-d891f649-d919-4795-8a26-952f096b85da req-4472bb88-458b-4287-b9c3-1f312f45f0c6 tempest-DeleteServersTestJSON-1687130349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109" returned: 0 in 1.083s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:07:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-d891f649-d919-4795-8a26-952f096b85da req-4472bb88-458b-4287-b9c3-1f312f45f0c6 tempest-DeleteServersTestJSON-1687130349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.121s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:07:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-d891f649-d919-4795-8a26-952f096b85da req-4472bb88-458b-4287-b9c3-1f312f45f0c6 tempest-DeleteServersTestJSON-1687130349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c', 'name': 'volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6195d05f-4ecc-48c2-bfc1-8b86b69d10cf', 'enforce_multipath': True} {{(pid=82392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 16:07:53 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-d891f649-d919-4795-8a26-952f096b85da req-4472bb88-458b-4287-b9c3-1f312f45f0c6 tempest-DeleteServersTestJSON-1687130349 None] attachment_update completed successfully. Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Flow 'volume_create_manager' (4b6ef20e-9f29-46c2-bd17-2d28afe74b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf77f83f-ed2c-4f18-9079-e8fb89572503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf77f83f-ed2c-4f18-9079-e8fb89572503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1906110811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e795361a-c4d2-4dc0-abbd-4fa85649658d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba8c1130e2414253a62a9ef1c52138da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:00Z,use_quota=True,user_id='d5499f0cb91949b59389b59fe519d445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477461f1-a96e-46de-b34d-375e82e82726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477461f1-a96e-46de-b34d-375e82e82726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff576016-97f6-48ff-918b-0eb932484572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff576016-97f6-48ff-918b-0eb932484572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e795361a-c4d2-4dc0-abbd-4fa85649658d', 'volume_name': 'volume-e795361a-c4d2-4dc0-abbd-4fa85649658d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2185116-c01b-479b-9ae2-dcc0bfcc39d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2185116-c01b-479b-9ae2-dcc0bfcc39d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7486fa-6c47-4eac-ad1d-86af81bc811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Volume e795361a-c4d2-4dc0-abbd-4fa85649658d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e795361a-c4d2-4dc0-abbd-4fa85649658d', 'volume_size': 1} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1906110811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e795361a-c4d2-4dc0-abbd-4fa85649658d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba8c1130e2414253a62a9ef1c52138da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:00Z,use_quota=True,user_id='d5499f0cb91949b59389b59fe519d445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Creating volume e795361a-c4d2-4dc0-abbd-4fa85649658d {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:08:00 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:08:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:00 devstack sudo[84065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d 1073741824 Apr 15 16:08:00 devstack sudo[84065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:01 devstack sudo[84065]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d 1073741824" returned: 0 in 0.829s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:01 devstack sudo[84073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d Apr 15 16:08:01 devstack sudo[84073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-2020ebe3-960d-4444-946b-cdbcd9cf3c7f req-5a90c73b-3068-465d-a5ef-05f140ef5b59 tempest-DeleteServersTestJSON-1687130349 None] Terminate volume connection completed successfully. Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-2020ebe3-960d-4444-946b-cdbcd9cf3c7f req-5a90c73b-3068-465d-a5ef-05f140ef5b59 tempest-DeleteServersTestJSON-1687130349 None] Deleting attachment 6195d05f-4ecc-48c2-bfc1-8b86b69d10cf. {{(pid=82392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 16:08:01 devstack sudo[84073]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d" returned: 0 in 0.542s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7486fa-6c47-4eac-ad1d-86af81bc811e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e795361a-c4d2-4dc0-abbd-4fa85649658d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6722928-2e42-4158-bdfe-8c51fe3a7368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:01 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Volume volume-e795361a-c4d2-4dc0-abbd-4fa85649658d (e795361a-c4d2-4dc0-abbd-4fa85649658d): created successfully Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6722928-2e42-4158-bdfe-8c51fe3a7368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Flow 'volume_create_manager' (4b6ef20e-9f29-46c2-bd17-2d28afe74b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-78104556-088c-470d-9c3d-886c594b19aa tempest-VolumesTestJSON-1891969947 None] Created volume successfully. Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Flow 'volume_create_manager' (2e1d8a3e-2c77-4b9b-9d1b-2eb375d67fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c246c9-05af-40aa-b97d-ce9d130b2572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c246c9-05af-40aa-b97d-ce9d130b2572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2077248434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fdfefb-f317-49d9-a641-384cb1409283,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba8c1130e2414253a62a9ef1c52138da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:03Z,use_quota=True,user_id='d5499f0cb91949b59389b59fe519d445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c33163-1317-435a-8410-d4cd6038c0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c33163-1317-435a-8410-d4cd6038c0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672d54a9-7f81-498e-9de6-cf2e2d3ebff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672d54a9-7f81-498e-9de6-cf2e2d3ebff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fdfefb-f317-49d9-a641-384cb1409283', 'volume_name': 'volume-08fdfefb-f317-49d9-a641-384cb1409283', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6ef0f8-1a25-4288-accd-5e78f3726e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6ef0f8-1a25-4288-accd-5e78f3726e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f80cbd-511c-40c1-911e-5c463035a35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:02 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Volume 08fdfefb-f317-49d9-a641-384cb1409283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fdfefb-f317-49d9-a641-384cb1409283', 'volume_size': 1} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2077248434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fdfefb-f317-49d9-a641-384cb1409283,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba8c1130e2414253a62a9ef1c52138da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:03Z,use_quota=True,user_id='d5499f0cb91949b59389b59fe519d445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Creating volume 08fdfefb-f317-49d9-a641-384cb1409283 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:08:02 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:08:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:02 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 1073741824 Apr 15 16:08:02 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:03 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 1073741824" returned: 0 in 0.704s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:03 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 Apr 15 16:08:03 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:03 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283" returned: 0 in 0.561s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:03 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:03 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f80cbd-511c-40c1-911e-5c463035a35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fdfefb-f317-49d9-a641-384cb1409283', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364a57ef-8e59-4cf4-9c46-4b705322e458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:03 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Volume volume-08fdfefb-f317-49d9-a641-384cb1409283 (08fdfefb-f317-49d9-a641-384cb1409283): created successfully Apr 15 16:08:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364a57ef-8e59-4cf4-9c46-4b705322e458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Flow 'volume_create_manager' (2e1d8a3e-2c77-4b9b-9d1b-2eb375d67fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:04 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-694385eb-54a1-4802-b242-c4a5bff45311 tempest-VolumesTestJSON-1891969947 None] Created volume successfully. Apr 15 16:08:04 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.474s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Flow 'volume_create_manager' (2d425412-2adc-4926-bfdb-403312e29afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14fb486-41f3-4c0a-b342-e6e1fe9b8299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14fb486-41f3-4c0a-b342-e6e1fe9b8299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-921786585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10866cf2-e27f-478a-804d-72e7c05748ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba8c1130e2414253a62a9ef1c52138da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:05Z,use_quota=True,user_id='d5499f0cb91949b59389b59fe519d445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15381d8b-352a-4c08-ae9f-6b661cccabbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15381d8b-352a-4c08-ae9f-6b661cccabbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ff0b03-c253-4397-bbea-8021d0e9ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ff0b03-c253-4397-bbea-8021d0e9ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10866cf2-e27f-478a-804d-72e7c05748ec', 'volume_name': 'volume-10866cf2-e27f-478a-804d-72e7c05748ec', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45d5988-9015-465b-b866-cef1558f5366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45d5988-9015-465b-b866-cef1558f5366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fbb244-d889-4fca-b260-3bb98f1508cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:05 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Volume 10866cf2-e27f-478a-804d-72e7c05748ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10866cf2-e27f-478a-804d-72e7c05748ec', 'volume_size': 1} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-921786585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10866cf2-e27f-478a-804d-72e7c05748ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba8c1130e2414253a62a9ef1c52138da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:05Z,use_quota=True,user_id='d5499f0cb91949b59389b59fe519d445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Creating volume 10866cf2-e27f-478a-804d-72e7c05748ec {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:08:05 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:05 devstack sudo[84495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec 1073741824 Apr 15 16:08:05 devstack sudo[84495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:05 devstack sudo[84495]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec 1073741824" returned: 0 in 0.605s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:05 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec Apr 15 16:08:05 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Acquiring lock "cinder-cd496cde-f0c7-4aee-aaf3-6dcc5607f109-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Lock "cinder-cd496cde-f0c7-4aee-aaf3-6dcc5607f109-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Acquiring lock "cinder-quobyte-cd496cde-f0c7-4aee-aaf3-6dcc5607f109" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Lock "cinder-quobyte-cd496cde-f0c7-4aee-aaf3-6dcc5607f109" acquired by "delete_volume" :: waited 0.025s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[942350c1-697d-4f39-b5f0-1404c3820e23]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:06 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 Apr 15 16:08:06 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:06 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec" returned: 0 in 0.803s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fbb244-d889-4fca-b260-3bb98f1508cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10866cf2-e27f-478a-804d-72e7c05748ec', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85c4047-807c-44d2-8c82-5266afdc561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:06 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Volume volume-10866cf2-e27f-478a-804d-72e7c05748ec (10866cf2-e27f-478a-804d-72e7c05748ec): created successfully Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85c4047-807c-44d2-8c82-5266afdc561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Flow 'volume_create_manager' (2d425412-2adc-4926-bfdb-403312e29afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:06 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-113e0a06-a258-4084-a695-f40c2340a57e tempest-VolumesTestJSON-1891969947 None] Created volume successfully. Apr 15 16:08:07 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109" returned: 0 in 0.836s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:07 devstack sudo[84513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109 Apr 15 16:08:07 devstack sudo[84513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:07 devstack sudo[84513]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cd496cde-f0c7-4aee-aaf3-6dcc5607f109" returned: 0 in 0.472s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Lock "cinder-quobyte-cd496cde-f0c7-4aee-aaf3-6dcc5607f109" released by "delete_volume" :: held 1.372s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Created reservations ['bfb8c163-28e4-4b01-a9d8-97792bde4c3e', '2ca27d8f-89a1-4c01-a42d-f2e80b6f581b', 'fa024d91-40d3-435d-bbc1-827f09c50725', '112862cf-782c-459e-bb42-81ed8dcef36e'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:07 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:07 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:08 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.524s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:08:08 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Deleted volume successfully. Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-502dea74-cade-4c1e-b9d0-55d7e08245ee tempest-DeleteServersTestJSON-1687130349 None] Lock "cinder-cd496cde-f0c7-4aee-aaf3-6dcc5607f109-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Acquiring lock "cinder-10866cf2-e27f-478a-804d-72e7c05748ec-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Lock "cinder-10866cf2-e27f-478a-804d-72e7c05748ec-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Acquiring lock "cinder-quobyte-10866cf2-e27f-478a-804d-72e7c05748ec" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Lock "cinder-quobyte-10866cf2-e27f-478a-804d-72e7c05748ec" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[502ec6b7-42a5-4216-bde9-6f4aff6a8948]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:08:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:09 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec Apr 15 16:08:09 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:09 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec" returned: 0 in 0.793s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:09 devstack sudo[84571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec Apr 15 16:08:09 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:10 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10866cf2-e27f-478a-804d-72e7c05748ec" returned: 0 in 0.667s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Lock "cinder-quobyte-10866cf2-e27f-478a-804d-72e7c05748ec" released by "delete_volume" :: held 1.504s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Created reservations ['143b95d2-9ec9-4cfe-8e00-7818d06048bf', '493ec89c-3e77-4ba1-929c-b65970b283a9', 'fb4d19bc-9093-44bc-a0ad-933cc3e01d5d', '519445ff-6890-4c34-891a-a2fc1db19efa'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:10 devstack sudo[84575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:10 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:11 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.475s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:08:11 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Deleted volume successfully. Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1f4bcdd9-03da-4c17-a2b1-71cbeaf3bbd9 tempest-VolumesTestJSON-1891969947 None] Lock "cinder-10866cf2-e27f-478a-804d-72e7c05748ec-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Acquiring lock "cinder-08fdfefb-f317-49d9-a641-384cb1409283-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Lock "cinder-08fdfefb-f317-49d9-a641-384cb1409283-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Acquiring lock "cinder-quobyte-08fdfefb-f317-49d9-a641-384cb1409283" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Lock "cinder-quobyte-08fdfefb-f317-49d9-a641-384cb1409283" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eac5849-00c4-4360-a17c-b5693a201104]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:11 devstack sudo[84579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 Apr 15 16:08:11 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:11 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283" returned: 0 in 0.695s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:11 devstack sudo[84588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283 Apr 15 16:08:11 devstack sudo[84588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:12 devstack sudo[84588]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-08fdfefb-f317-49d9-a641-384cb1409283" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Lock "cinder-quobyte-08fdfefb-f317-49d9-a641-384cb1409283" released by "delete_volume" :: held 1.182s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Created reservations ['25fdbb78-b6e6-4a96-82ef-b21a5ec66617', '9d9f7502-2db0-4871-ac8d-35e9736de9fb', '686f9062-ad75-4de2-b9a3-964032b463b6', 'ba26081e-ff1c-4fd3-bab3-034f2cc78f0b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:12 devstack sudo[84591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:12 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:12 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.494s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:08:12 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Deleted volume successfully. Apr 15 16:08:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-615e68bb-d1bd-4cbe-9baa-80694b957e0a tempest-VolumesTestJSON-1891969947 None] Lock "cinder-08fdfefb-f317-49d9-a641-384cb1409283-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Acquiring lock "cinder-e795361a-c4d2-4dc0-abbd-4fa85649658d-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Lock "cinder-e795361a-c4d2-4dc0-abbd-4fa85649658d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Acquiring lock "cinder-quobyte-e795361a-c4d2-4dc0-abbd-4fa85649658d" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Lock "cinder-quobyte-e795361a-c4d2-4dc0-abbd-4fa85649658d" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:13 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84898b1-04fd-4db2-8580-0dead508f638]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:08:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:13 devstack sudo[84594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d Apr 15 16:08:13 devstack sudo[84594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:14 devstack sudo[84594]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d" returned: 0 in 0.712s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:14 devstack sudo[84600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d Apr 15 16:08:14 devstack sudo[84600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:14 devstack sudo[84600]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e795361a-c4d2-4dc0-abbd-4fa85649658d" returned: 0 in 0.614s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Lock "cinder-quobyte-e795361a-c4d2-4dc0-abbd-4fa85649658d" released by "delete_volume" :: held 1.366s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Created reservations ['34c56c25-225c-4aea-9630-dfb92e6aac33', '22201ced-780a-42aa-8c90-ea0ed344d9c7', '7f718c85-7217-48ca-9daa-777bbaa24c0b', '7a8a0e98-c166-45b2-9b40-5d4ac25c93b6'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:15 devstack sudo[84612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:15 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:15 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.635s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:15 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:08:15 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Deleted volume successfully. Apr 15 16:08:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dcf811ab-814c-4673-9aae-627d51ec24e0 tempest-VolumesTestJSON-1891969947 None] Lock "cinder-e795361a-c4d2-4dc0-abbd-4fa85649658d-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:20 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=59,cinder:UPDATE=67,cinder:INSERT=18,cinder:DELETE=7 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:08:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6554f713-1182-45d5-89c0-ee61d06bbd37 tempest-GroupsV320Test-1644734245 None] Group tempest-GroupsV320Test-Group-413364201: creating Apr 15 16:08:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6554f713-1182-45d5-89c0-ee61d06bbd37 tempest-GroupsV320Test-1644734245 None] Group tempest-GroupsV320Test-Group-413364201: created successfully Apr 15 16:08:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6554f713-1182-45d5-89c0-ee61d06bbd37 tempest-GroupsV320Test-1644734245 None] Create group completed successfully. Apr 15 16:08:22 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Created reservations ['ae05295a-2795-4be9-88ea-5ed754e26514'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:08:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:22 devstack sudo[84663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:22 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:23 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.555s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:23 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:08:23 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8591a68f-7ee4-4929-986f-d52cdcec0ba2 tempest-GroupsV320Test-1644734245 None] Delete group completed successfully. Apr 15 16:08:25 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:UPDATE=82,cinder:SELECT=62,cinder:DELETE=6,cinder:INSERT=14 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (a2124900-3d14-4a62-a670-2604faf7bb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4d91ee-86f6-49a4-aa03-87d68648511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4d91ee-86f6-49a4-aa03-87d68648511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-65087935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3a0da9-0e59-4693-9289-ef66988f6e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:35Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55206568-0882-4ffe-bd66-984c9c4d89e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55206568-0882-4ffe-bd66-984c9c4d89e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3148d7-345a-4426-8d2f-2d52c2f56511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3148d7-345a-4426-8d2f-2d52c2f56511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3a0da9-0e59-4693-9289-ef66988f6e77', 'volume_name': 'volume-5c3a0da9-0e59-4693-9289-ef66988f6e77', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289c983e-a287-404a-b8ac-4ef7fc3d5d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289c983e-a287-404a-b8ac-4ef7fc3d5d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9acd50-5024-42df-b6f6-4efa801921d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:35 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Volume 5c3a0da9-0e59-4693-9289-ef66988f6e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3a0da9-0e59-4693-9289-ef66988f6e77', 'volume_size': 1} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-65087935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3a0da9-0e59-4693-9289-ef66988f6e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:35Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Creating volume 5c3a0da9-0e59-4693-9289-ef66988f6e77 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:08:35 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:08:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:35 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 1073741824 Apr 15 16:08:35 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:36 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 1073741824" returned: 0 in 1.415s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:36 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 Apr 15 16:08:36 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:37 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77" returned: 0 in 1.136s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] <== create_volume: return (2635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:08:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.639s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9acd50-5024-42df-b6f6-4efa801921d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3a0da9-0e59-4693-9289-ef66988f6e77', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c558973-2c6d-485a-9681-8c9ea8954aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:37 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Volume volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 (5c3a0da9-0e59-4693-9289-ef66988f6e77): created successfully Apr 15 16:08:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c558973-2c6d-485a-9681-8c9ea8954aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (a2124900-3d14-4a62-a670-2604faf7bb18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:37 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a9366a2c-6317-4e68-a71c-8b84729815cc tempest-VolumesActionsTest-1152819994 None] Created volume successfully. Apr 15 16:08:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b0c0aa6-78de-4f3a-b2d8-d9c8b10141a5 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77" by "attach_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b0c0aa6-78de-4f3a-b2d8-d9c8b10141a5 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77" acquired by "attach_volume" :: waited 0.027s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:38 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-9b0c0aa6-78de-4f3a-b2d8-d9c8b10141a5 tempest-VolumesActionsTest-1152819994 None] Attaching volume 5c3a0da9-0e59-4693-9289-ef66988f6e77 to instance 8132cc59-885b-466d-85b2-739c4686c26c at mountpoint /dev/vdb on host None. Apr 15 16:08:38 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-9b0c0aa6-78de-4f3a-b2d8-d9c8b10141a5 tempest-VolumesActionsTest-1152819994 None] Attach volume completed successfully. Apr 15 16:08:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b0c0aa6-78de-4f3a-b2d8-d9c8b10141a5 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77" released by "attach_volume" :: held 0.179s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:39 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-96d31864-1634-4532-937f-31f42e12d611 tempest-VolumesActionsTest-1102262053 None] Terminate volume connection completed successfully. Apr 15 16:08:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-96d31864-1634-4532-937f-31f42e12d611 tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-detach_volume" by "detach_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-96d31864-1634-4532-937f-31f42e12d611 tempest-VolumesActionsTest-1102262053 None] Lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-96d31864-1634-4532-937f-31f42e12d611 tempest-VolumesActionsTest-1102262053 None] Detaching volume 5c3a0da9-0e59-4693-9289-ef66988f6e77 from instance 8132cc59-885b-466d-85b2-739c4686c26c. Apr 15 16:08:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-96d31864-1634-4532-937f-31f42e12d611 tempest-VolumesActionsTest-1102262053 None] Detach volume completed successfully. Apr 15 16:08:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-96d31864-1634-4532-937f-31f42e12d611 tempest-VolumesActionsTest-1102262053 None] Lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-detach_volume" released by "detach_volume" :: held 0.138s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-938acd0d-403a-4669-958c-e8c5fdbd511a tempest-VolumesActionsTest-1152819994 None] Acquiring lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-detach_volume" by "detach_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-938acd0d-403a-4669-958c-e8c5fdbd511a tempest-VolumesActionsTest-1152819994 None] Lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-938acd0d-403a-4669-958c-e8c5fdbd511a tempest-VolumesActionsTest-1152819994 None] Volume detach called, but volume not attached. Apr 15 16:08:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-938acd0d-403a-4669-958c-e8c5fdbd511a tempest-VolumesActionsTest-1152819994 None] Lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "cinder-quobyte-5c3a0da9-0e59-4693-9289-ef66988f6e77" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-quobyte-5c3a0da9-0e59-4693-9289-ef66988f6e77" acquired by "delete_volume" :: waited 0.026s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:41 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58e4d19-5938-4351-8226-e09ca7de288e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:08:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:42 devstack sudo[84894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 Apr 15 16:08:42 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:43 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77" returned: 0 in 1.740s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:43 devstack sudo[84925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77 Apr 15 16:08:43 devstack sudo[84925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:44 devstack sudo[84925]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5c3a0da9-0e59-4693-9289-ef66988f6e77" returned: 0 in 0.832s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-quobyte-5c3a0da9-0e59-4693-9289-ef66988f6e77" released by "delete_volume" :: held 2.664s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Created reservations ['73f548b0-4f9f-40b8-9644-95c145142f0c', 'd3e1abf5-a175-4b76-8f6f-25d47d290b51', '80f13f58-1130-4e53-9e40-f2ea54a68c18', 'b7be19ef-e98d-43a5-b08c-6cc4d71cbd87'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:44 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:44 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:45 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.890s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:45 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:08:45 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Deleted volume successfully. Apr 15 16:08:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f933cb5-b0b3-4e2b-95fe-5f431b656d01 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-5c3a0da9-0e59-4693-9289-ef66988f6e77-delete_volume" released by "delete_volume" :: held 3.988s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Flow 'volume_create_manager' (63041c53-3280-477e-b49d-cf8611bd4052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0caeaa22-4323-4a71-82d7-b88a83a1138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0caeaa22-4323-4a71-82d7-b88a83a1138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1144721668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e30386-fa2b-4989-823c-ef35873cc913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e31f06082cf4e448dd1fa21f7c1a37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:50Z,use_quota=True,user_id='eef6a016d91d49bd8bde0c976760f391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ac7692-6210-43e7-9553-bc9519e1ea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ac7692-6210-43e7-9553-bc9519e1ea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbde7d2c-50bc-4184-ba26-70c793c46774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbde7d2c-50bc-4184-ba26-70c793c46774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e30386-fa2b-4989-823c-ef35873cc913', 'volume_name': 'volume-53e30386-fa2b-4989-823c-ef35873cc913', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263adfa9-5ec3-48f9-9b31-6f8bf51726a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263adfa9-5ec3-48f9-9b31-6f8bf51726a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda7227c-c658-4451-8220-5744f561dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:50 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Volume 53e30386-fa2b-4989-823c-ef35873cc913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e30386-fa2b-4989-823c-ef35873cc913', 'volume_size': 1} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1144721668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e30386-fa2b-4989-823c-ef35873cc913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e31f06082cf4e448dd1fa21f7c1a37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:50Z,use_quota=True,user_id='eef6a016d91d49bd8bde0c976760f391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Creating volume 53e30386-fa2b-4989-823c-ef35873cc913 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:08:50 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:08:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:50 devstack sudo[85026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 1073741824 Apr 15 16:08:50 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:51 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 1073741824" returned: 0 in 0.895s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:51 devstack sudo[85032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 Apr 15 16:08:51 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:52 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913" returned: 0 in 0.682s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda7227c-c658-4451-8220-5744f561dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e30386-fa2b-4989-823c-ef35873cc913', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63eaad4e-0e47-45d0-b123-9eb49cd67ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:52 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Volume volume-53e30386-fa2b-4989-823c-ef35873cc913 (53e30386-fa2b-4989-823c-ef35873cc913): created successfully Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63eaad4e-0e47-45d0-b123-9eb49cd67ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Flow 'volume_create_manager' (63041c53-3280-477e-b49d-cf8611bd4052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:52 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e1ae3803-c795-4784-9f9b-25b9a6ec9cc4 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Created volume successfully. Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Acquiring lock "cinder-53e30386-fa2b-4989-823c-ef35873cc913-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "cinder-53e30386-fa2b-4989-823c-ef35873cc913-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Acquiring lock "cinder-quobyte-53e30386-fa2b-4989-823c-ef35873cc913" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "cinder-quobyte-53e30386-fa2b-4989-823c-ef35873cc913" acquired by "delete_volume" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ae565e-96c7-42fe-8141-8bdd7f744bed]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:08:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:53 devstack sudo[85062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 Apr 15 16:08:53 devstack sudo[85062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (72002522-b985-4f37-bbd7-b92d479cddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5286378-9f9e-4f02-8b14-90d830176200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5286378-9f9e-4f02-8b14-90d830176200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1734813554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99420f3-b33f-4465-815e-417b030d9924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:53Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ad4746-4c8f-4b53-89eb-e212379b3021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ad4746-4c8f-4b53-89eb-e212379b3021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80313e3-b698-4914-a755-686e5054abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80313e3-b698-4914-a755-686e5054abb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99420f3-b33f-4465-815e-417b030d9924', 'volume_name': 'volume-f99420f3-b33f-4465-815e-417b030d9924', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f846d39a-f1c9-4f12-9df3-2feeb71fb4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f846d39a-f1c9-4f12-9df3-2feeb71fb4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e05e8d3-9fa9-45d1-bd16-4370bf26423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:53 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Volume f99420f3-b33f-4465-815e-417b030d9924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99420f3-b33f-4465-815e-417b030d9924', 'volume_size': 1} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1734813554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99420f3-b33f-4465-815e-417b030d9924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:53Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Creating volume f99420f3-b33f-4465-815e-417b030d9924 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:08:53 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:53 devstack sudo[85071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 1073741824 Apr 15 16:08:53 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:53 devstack sudo[85062]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913" returned: 0 in 0.739s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:53 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913 Apr 15 16:08:53 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:54 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 1073741824" returned: 0 in 0.781s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:54 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 Apr 15 16:08:54 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:54 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-53e30386-fa2b-4989-823c-ef35873cc913" returned: 0 in 0.699s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "cinder-quobyte-53e30386-fa2b-4989-823c-ef35873cc913" released by "delete_volume" :: held 1.474s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Created reservations ['6d401077-41f5-4e83-9454-20a7229c9a14', 'a123fe7c-52fb-4a54-8684-2c2a841d3c26', '1e31f519-b232-4a75-9720-7e7640010d5a', '8572ad87-037c-41fd-b94c-d874e41bd6bc'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:54 devstack sudo[85091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:54 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:54 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924" returned: 0 in 0.696s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e05e8d3-9fa9-45d1-bd16-4370bf26423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99420f3-b33f-4465-815e-417b030d9924', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d60d02-1797-4a5f-a87e-79e488fef014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:54 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Volume volume-f99420f3-b33f-4465-815e-417b030d9924 (f99420f3-b33f-4465-815e-417b030d9924): created successfully Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d60d02-1797-4a5f-a87e-79e488fef014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (72002522-b985-4f37-bbd7-b92d479cddf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:54 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-084c5713-fca0-4a67-bdad-fa4fe7251c1c tempest-VolumesActionsTest-1152819994 None] Created volume successfully. Apr 15 16:08:55 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.647s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:08:55 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Deleted volume successfully. Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c16186a8-5f0f-4fcb-bca4-8c7b8c95f398 tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "cinder-53e30386-fa2b-4989-823c-ef35873cc913-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Flow 'volume_create_manager' (0447e1bd-9938-4b01-a704-c8301e2b2ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e016e87-51ca-48ea-9657-7a54dc9cd281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-f99420f3-b33f-4465-815e-417b030d9924-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e016e87-51ca-48ea-9657-7a54dc9cd281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1191588002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7088416-c38a-4942-a949-dc277e19200f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e31f06082cf4e448dd1fa21f7c1a37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:56Z,use_quota=True,user_id='eef6a016d91d49bd8bde0c976760f391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f05a342-6ac7-4a9a-be37-341576825afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f05a342-6ac7-4a9a-be37-341576825afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad0b59e-bcf0-4739-9476-bed3473f5703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad0b59e-bcf0-4739-9476-bed3473f5703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7088416-c38a-4942-a949-dc277e19200f', 'volume_name': 'volume-c7088416-c38a-4942-a949-dc277e19200f', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461708de-2125-4b75-8c80-2ee0b3474417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461708de-2125-4b75-8c80-2ee0b3474417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7aad5f-f4c4-49ca-a010-9e7658f75ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:55 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Volume c7088416-c38a-4942-a949-dc277e19200f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7088416-c38a-4942-a949-dc277e19200f', 'volume_size': 1} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1191588002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7088416-c38a-4942-a949-dc277e19200f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e31f06082cf4e448dd1fa21f7c1a37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:56Z,use_quota=True,user_id='eef6a016d91d49bd8bde0c976760f391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Creating volume c7088416-c38a-4942-a949-dc277e19200f {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:08:55 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Lock "cinder-f99420f3-b33f-4465-815e-417b030d9924-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-quobyte-f99420f3-b33f-4465-815e-417b030d9924" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:08:55 devstack sudo[85096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f 1073741824 Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Lock "cinder-quobyte-f99420f3-b33f-4465-815e-417b030d9924" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:08:55 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8d1f2a-ba5c-4a50-94d0-6b48b051fdee]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:08:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:55 devstack sudo[85099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 Apr 15 16:08:55 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:57 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924" returned: 0 in 1.328s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:57 devstack sudo[85135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924 Apr 15 16:08:57 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:57 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f 1073741824" returned: 0 in 1.545s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:57 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f Apr 15 16:08:57 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Flow 'volume_create_manager' (a2f70bd7-cfa7-4c63-a5b6-ad3432810589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958a3bc7-0428-4ca6-b4aa-7f6bbe35ab81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:58 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958a3bc7-0428-4ca6-b4aa-7f6bbe35ab81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:58Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02abae76-0ebe-48c1-b259-bf063a9a2d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f1639bcc7144cca70cbf3397a66dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:58Z,use_quota=True,user_id='47ac8e86582a4af796155d03fc825783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:58 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5d6b1a-3d92-4f0d-becf-3d38ddffbf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5d6b1a-3d92-4f0d-becf-3d38ddffbf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbf7917-f58f-4f4e-a5f6-5dc29d0384f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.image.glance [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Creating Keystone auth plugin from conf {{(pid=82392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f99420f3-b33f-4465-815e-417b030d9924" returned: 0 in 1.651s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f" returned: 0 in 1.484s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] <== create_volume: return (3097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.099s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Lock "cinder-quobyte-f99420f3-b33f-4465-815e-417b030d9924" released by "delete_volume" :: held 3.041s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7aad5f-f4c4-49ca-a010-9e7658f75ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7088416-c38a-4942-a949-dc277e19200f', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6631df1a-1e64-45cd-92fb-9f60cbe6d7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Created reservations ['a1b5b0a3-d39f-41bd-b085-1bb938ba9b50', '6ad29da0-a431-400d-9bab-9b814a26c1ad', '157f87f7-70e9-42ea-86e0-5edeb7b39a4b', '0b80d8b9-8d43-45a4-96a5-5843d91bb9e2'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:08:59 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Volume volume-c7088416-c38a-4942-a949-dc277e19200f (c7088416-c38a-4942-a949-dc277e19200f): created successfully Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6631df1a-1e64-45cd-92fb-9f60cbe6d7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Flow 'volume_create_manager' (0447e1bd-9938-4b01-a704-c8301e2b2ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-eaa16392-95e1-405c-bf98-93f7661da33e tempest-VolumeQuotasAdminTestJSON-2119624326 None] Created volume successfully. Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:59 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:08:59 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbf7917-f58f-4f4e-a5f6-5dc29d0384f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02abae76-0ebe-48c1-b259-bf063a9a2d6a', 'volume_name': 'volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace016c1-66df-4b55-87f1-a728a9adc565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace016c1-66df-4b55-87f1-a728a9adc565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9757ba6d-91d5-4f83-ad9c-749d5be73b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:59 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Volume 02abae76-0ebe-48c1-b259-bf063a9a2d6a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Trying to clone 02abae76-0ebe-48c1-b259-bf063a9a2d6a from image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]). {{(pid=82392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (2811ed97-dee1-47a0-a68f-71deffeda27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5291de24-7348-4478-b385-770a80da069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5291de24-7348-4478-b385-770a80da069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1560725778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b558f074-ec64-4c70-9336-07fea3bbf9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:00Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af411470-98fe-4d7e-83d2-ec314b9c381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af411470-98fe-4d7e-83d2-ec314b9c381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689577e-4eef-44c3-aefc-77a2ef78b34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689577e-4eef-44c3-aefc-77a2ef78b34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b558f074-ec64-4c70-9336-07fea3bbf9d2', 'volume_name': 'volume-b558f074-ec64-4c70-9336-07fea3bbf9d2', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5cf2b0-1f85-4493-be90-93f8b45b51df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5cf2b0-1f85-4493-be90-93f8b45b51df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749e6e2b-082c-4753-bc85-4638280a1013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:08:59 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Volume b558f074-ec64-4c70-9336-07fea3bbf9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b558f074-ec64-4c70-9336-07fea3bbf9d2', 'volume_size': 1} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1560725778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b558f074-ec64-4c70-9336-07fea3bbf9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:00Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Creating volume b558f074-ec64-4c70-9336-07fea3bbf9d2 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:08:59 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:08:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:08:59 devstack sudo[85193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 1073741824 Apr 15 16:08:59 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:00 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 16:09:00 devstack cinder-volume[82392]: INFO cinder.image.image_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Image download 20.69 MB at 20.69 MB/s Apr 15 16:09:00 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff4465-f43c-4913-a5c3-850a62ed7e09]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:00 devstack sudo[85196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD Apr 15 16:09:00 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:00 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.509s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:00 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:00 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Deleted volume successfully. Apr 15 16:09:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2dbb6ea8-b1fa-42f4-a51b-b47c9e193acf tempest-VolumesActionsTest-1102262053 None] Lock "cinder-f99420f3-b33f-4465-815e-417b030d9924-delete_volume" released by "delete_volume" :: held 4.975s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c58e56c3-cad0-42ae-b741-c66150b7bff6 tempest-VolumeQuotasAdminTestJSON-776174408 None] Transfer volume completed successfully. Apr 15 16:09:01 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 1073741824" returned: 0 in 1.599s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:01 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 Apr 15 16:09:01 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:01 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD" returned: 0 in 1.440s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:01 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Temporary image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 is fetched for user 47ac8e86582a4af796155d03fc825783. {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 16:09:01 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7045947c-84cc-43ef-909f-515cc443eb27]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:01 devstack sudo[85208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD Apr 15 16:09:01 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:01 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Flow 'volume_create_manager' (b797b7e7-695d-427d-9406-94b1faa6bad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22abda0e-c714-420b-aad7-72ee6c2acc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22abda0e-c714-420b-aad7-72ee6c2acc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2010567331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1757fdd-2703-4ae2-bf53-5e23d1042985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323796b322f04cfba22e9bd65496c791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:02Z,use_quota=True,user_id='7b0cff4bca6e4608812588dbd21acfd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa1992b-44f3-4979-a01a-97976cf0300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa1992b-44f3-4979-a01a-97976cf0300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9774d93c-4047-49b5-b1c2-f941e874c693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9774d93c-4047-49b5-b1c2-f941e874c693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1757fdd-2703-4ae2-bf53-5e23d1042985', 'volume_name': 'volume-f1757fdd-2703-4ae2-bf53-5e23d1042985', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d879b49-00a0-406c-a870-d09a7ac1ce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d879b49-00a0-406c-a870-d09a7ac1ce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ef1271-4e90-4eac-b4da-09fd375fe249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:02 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Volume f1757fdd-2703-4ae2-bf53-5e23d1042985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1757fdd-2703-4ae2-bf53-5e23d1042985', 'volume_size': 1} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:02 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2" returned: 0 in 0.758s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.102s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2010567331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1757fdd-2703-4ae2-bf53-5e23d1042985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323796b322f04cfba22e9bd65496c791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:02Z,use_quota=True,user_id='7b0cff4bca6e4608812588dbd21acfd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Creating volume f1757fdd-2703-4ae2-bf53-5e23d1042985 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:02 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:02 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 1073741824 Apr 15 16:09:02 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749e6e2b-082c-4753-bc85-4638280a1013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b558f074-ec64-4c70-9336-07fea3bbf9d2', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98df86e-5d87-4c69-89ed-cb1addc05a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:02 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Volume volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 (b558f074-ec64-4c70-9336-07fea3bbf9d2): created successfully Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98df86e-5d87-4c69-89ed-cb1addc05a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (2811ed97-dee1-47a0-a68f-71deffeda27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:02 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6d973f12-62cc-4df6-bf5d-3d4e784d7aa4 tempest-VolumesActionsTest-1152819994 None] Created volume successfully. Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Acquiring lock "cinder-c7088416-c38a-4942-a949-dc277e19200f-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Lock "cinder-c7088416-c38a-4942-a949-dc277e19200f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Acquiring lock "cinder-quobyte-c7088416-c38a-4942-a949-dc277e19200f" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Lock "cinder-quobyte-c7088416-c38a-4942-a949-dc277e19200f" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d073772c-8e5c-4554-bea6-c5186de8423a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:03 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD" returned: 0 in 1.413s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:03 devstack sudo[85218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f Apr 15 16:09:03 devstack sudo[85218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-b558f074-ec64-4c70-9336-07fea3bbf9d2-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Lock "cinder-b558f074-ec64-4c70-9336-07fea3bbf9d2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-quobyte-b558f074-ec64-4c70-9336-07fea3bbf9d2" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Lock "cinder-quobyte-b558f074-ec64-4c70-9336-07fea3bbf9d2" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[265f8c5f-82b0-48e8-bf2d-9aafbfdac703]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:03 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 1073741824" returned: 0 in 1.428s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:03 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 Apr 15 16:09:03 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:03 devstack sudo[85218]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f" returned: 0 in 0.934s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:03 devstack sudo[85227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 Apr 15 16:09:03 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:03 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f Apr 15 16:09:03 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:04 devstack sudo[85231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:04 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:04 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985" returned: 0 in 0.745s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] <== create_volume: return (2243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.251s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:04 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:08:58Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02abae76-0ebe-48c1-b259-bf063a9a2d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f1639bcc7144cca70cbf3397a66dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:08:58Z,use_quota=True,user_id='47ac8e86582a4af796155d03fc825783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Creating volume 02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:04 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ef1271-4e90-4eac-b4da-09fd375fe249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1757fdd-2703-4ae2-bf53-5e23d1042985', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532aa95a-ddbb-4a32-a577-7f1af3fb56e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c7088416-c38a-4942-a949-dc277e19200f" returned: 0 in 0.762s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:04 devstack sudo[85238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a 1073741824 Apr 15 16:09:04 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:04 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Volume volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 (f1757fdd-2703-4ae2-bf53-5e23d1042985): created successfully Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532aa95a-ddbb-4a32-a577-7f1af3fb56e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Flow 'volume_create_manager' (b797b7e7-695d-427d-9406-94b1faa6bad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Lock "cinder-quobyte-c7088416-c38a-4942-a949-dc277e19200f" released by "delete_volume" :: held 1.832s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:04 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0bfe0e35-78e2-443b-aeb3-a2ed7a7793c9 tempest-ServerRescueNegativeTestJSON-1097995838 None] Created volume successfully. Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Created reservations ['a984f1c7-3d5f-4e6b-98c9-9cbb1165be3d', '911c8cbf-ce92-4a71-aa7e-d5898b37b42b', 'd0c96115-714c-4dfd-a3b9-5c97439ee26c', '8cae0d98-507b-492b-ae46-a3cb02c96881'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:04 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2" returned: 0 in 1.089s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:04 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2 Apr 15 16:09:04 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:04 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:04 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:04 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.924s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:05 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a 1073741824" returned: 0 in 1.064s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:05 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:05 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:05 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b558f074-ec64-4c70-9336-07fea3bbf9d2" returned: 0 in 1.132s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Lock "cinder-quobyte-b558f074-ec64-4c70-9336-07fea3bbf9d2" released by "delete_volume" :: held 2.288s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:05 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Created reservations ['33a0e40e-7ef9-4c6a-a7c5-ecd02f415870', '4ecfc92a-193b-409b-a0d8-fb325680ad5c', 'd10c7c49-ed46-40c9-9d6e-45b7f1b49fdf', '5576203b-b357-40d0-b071-17361a1a57d1'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:06 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.442s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:06 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:06 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:06 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Deleted volume successfully. Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4ef8360-4d9e-4581-bff8-b6958951343c tempest-VolumeQuotasAdminTestJSON-158567757 None] Lock "cinder-c7088416-c38a-4942-a949-dc277e19200f-delete_volume" released by "delete_volume" :: held 3.584s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:06 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 0 in 0.987s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Attempting download of 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}])) to volume 02abae76-0ebe-48c1-b259-bf063a9a2d6a. {{(pid=82392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0613adb0-2cca-44eb-8075-4df487095581]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_q_b79gxp {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:07 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_q_b79gxp Apr 15 16:09:07 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:07 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.049s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:07 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:07 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Deleted volume successfully. Apr 15 16:09:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f17e8897-259d-4d63-979f-425d8a8910ae tempest-VolumesActionsTest-1102262053 None] Lock "cinder-b558f074-ec64-4c70-9336-07fea3bbf9d2-delete_volume" released by "delete_volume" :: held 3.791s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:07 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (758478e0-e835-4032-b059-76d205210ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390740d6-ac55-446c-a2b7-21cd5b53deed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390740d6-ac55-446c-a2b7-21cd5b53deed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555403443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a73233-f2b4-41a5-9804-b4bd76838a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:08Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4809e741-ec08-48d5-8809-6589879c2a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4809e741-ec08-48d5-8809-6589879c2a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b10a530-e805-472b-b17d-ff386972de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b10a530-e805-472b-b17d-ff386972de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a73233-f2b4-41a5-9804-b4bd76838a44', 'volume_name': 'volume-65a73233-f2b4-41a5-9804-b4bd76838a44', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcdb2eb-9925-4fce-9347-a50ceab39737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcdb2eb-9925-4fce-9347-a50ceab39737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e971599-e477-4872-9314-725596a5453c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:08 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Volume 65a73233-f2b4-41a5-9804-b4bd76838a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a73233-f2b4-41a5-9804-b4bd76838a44', 'volume_size': 1} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555403443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a73233-f2b4-41a5-9804-b4bd76838a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:08Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Creating volume 65a73233-f2b4-41a5-9804-b4bd76838a44 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:08 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:08 devstack sudo[85264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 1073741824 Apr 15 16:09:08 devstack sudo[85264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:08 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_q_b79gxp" returned: 0 in 1.698s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_q_b79gxp {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:08 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_q_b79gxp Apr 15 16:09:08 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:09 devstack sudo[85264]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 1073741824" returned: 0 in 1.264s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:09 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 Apr 15 16:09:09 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:09 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_q_b79gxp" returned: 1 in 1.416s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_q_b79gxp' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:09:09 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed331a7a-0fa1-44b2-ae86-cc69afe3640b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:10 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD Apr 15 16:09:10 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:10 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44" returned: 0 in 1.302s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] <== create_volume: return (2618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.621s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e971599-e477-4872-9314-725596a5453c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a73233-f2b4-41a5-9804-b4bd76838a44', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174ec521-bea3-4165-92da-048b8997fe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:10 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Volume volume-65a73233-f2b4-41a5-9804-b4bd76838a44 (65a73233-f2b4-41a5-9804-b4bd76838a44): created successfully Apr 15 16:09:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174ec521-bea3-4165-92da-048b8997fe9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (758478e0-e835-4032-b059-76d205210ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-319c30a2-27b2-4e2c-8d47-6f34f0cceae9 tempest-VolumesActionsTest-1152819994 None] Created volume successfully. Apr 15 16:09:11 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD" returned: 0 in 1.197s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 was qcow2, converting to raw {{(pid=82392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:11 devstack sudo[85311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:11 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-65a73233-f2b4-41a5-9804-b4bd76838a44-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Lock "cinder-65a73233-f2b4-41a5-9804-b4bd76838a44-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-quobyte-65a73233-f2b4-41a5-9804-b4bd76838a44" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Lock "cinder-quobyte-65a73233-f2b4-41a5-9804-b4bd76838a44" acquired by "delete_volume" :: waited 0.020s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd2d251-9bd1-4380-bc3f-e467f72fddf7]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:11 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 Apr 15 16:09:11 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:12 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 0 in 1.420s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:12 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_4ir0n0u2devstack@QuobyteHD, size 112.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:09:12 devstack cinder-volume[82392]: INFO cinder.image.image_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Converted 112.00 MB image at 78.63 MB/s Apr 15 16:09:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:12 devstack sudo[85325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a 1G Apr 15 16:09:12 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:12 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44" returned: 0 in 1.302s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:12 devstack sudo[85330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44 Apr 15 16:09:12 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:13 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a 1G" returned: 0 in 0.672s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d97aa-73d8-4891-8ea7-cc0e87eeab32]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:13 devstack sudo[85335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:13 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:13 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-65a73233-f2b4-41a5-9804-b4bd76838a44" returned: 0 in 0.620s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Lock "cinder-quobyte-65a73233-f2b4-41a5-9804-b4bd76838a44" released by "delete_volume" :: held 1.968s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Created reservations ['3956e860-3baf-4a04-bd07-d90903721536', '2e9557df-59c9-4510-a2cd-4bbf26d81ea9', '10ecee58-62dd-4273-a930-a5d0edfa6a81', 'd35653a7-c6f9-42d0-a229-0caa653fc5b9'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:13 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:13 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:14 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (0d2f2c4f-8c8f-49a2-bc5b-0eb69afb03b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f6edaa-f57d-4d1a-92d6-04a8c47dea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f6edaa-f57d-4d1a-92d6-04a8c47dea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-334923044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cfa650-37f2-443a-9cd9-e890aa26debe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:14Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945f1cc5-b568-4942-8c00-7a16b7ca51e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945f1cc5-b568-4942-8c00-7a16b7ca51e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931a8ea1-b477-4021-9707-8c78f720529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931a8ea1-b477-4021-9707-8c78f720529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38cfa650-37f2-443a-9cd9-e890aa26debe', 'volume_name': 'volume-38cfa650-37f2-443a-9cd9-e890aa26debe', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aadb6b4-aba0-4ada-bcdc-64caeedf491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aadb6b4-aba0-4ada-bcdc-64caeedf491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342cb5e8-6e52-4ef2-9f74-9781de52c745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:14 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Volume 38cfa650-37f2-443a-9cd9-e890aa26debe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38cfa650-37f2-443a-9cd9-e890aa26debe', 'volume_size': 1} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-334923044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cfa650-37f2-443a-9cd9-e890aa26debe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:14Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Creating volume 38cfa650-37f2-443a-9cd9-e890aa26debe {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:14 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 0 in 1.153s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:14 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.711s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Deleted volume successfully. Apr 15 16:09:14 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe 1073741824 Apr 15 16:09:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ce2954a3-0d8b-4a99-8c3a-55b7375d8a10 tempest-VolumesActionsTest-1102262053 None] Lock "cinder-65a73233-f2b4-41a5-9804-b4bd76838a44-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:14 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:14 devstack sudo[85345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:14 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:15 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 1 in 0.795s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Downloaded image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}])) to volume 02abae76-0ebe-48c1-b259-bf063a9a2d6a successfully. {{(pid=82392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Temporary image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 for user 47ac8e86582a4af796155d03fc825783 is deleted. {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Marking volume 02abae76-0ebe-48c1-b259-bf063a9a2d6a as bootable. {{(pid=82392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Copying metadata from image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 to 02abae76-0ebe-48c1-b259-bf063a9a2d6a. {{(pid=82392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Creating volume glance metadata for volume 02abae76-0ebe-48c1-b259-bf063a9a2d6a backed by image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9757ba6d-91d5-4f83-ad9c-749d5be73b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0533b3a9-87ea-4d88-a638-9e6903855797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:15 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Volume volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a (02abae76-0ebe-48c1-b259-bf063a9a2d6a): created successfully Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0533b3a9-87ea-4d88-a638-9e6903855797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Flow 'volume_create_manager' (a2f70bd7-cfa7-4c63-a5b6-ad3432810589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:15 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-f38e8c76-6706-4950-9231-3aa6a54c0fcc tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Created volume successfully. Apr 15 16:09:15 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe 1073741824" returned: 0 in 1.167s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:15 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe Apr 15 16:09:15 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:16 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe" returned: 0 in 0.701s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342cb5e8-6e52-4ef2-9f74-9781de52c745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38cfa650-37f2-443a-9cd9-e890aa26debe', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fada550e-7c26-434f-933e-73c2c06e3b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:16 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Volume volume-38cfa650-37f2-443a-9cd9-e890aa26debe (38cfa650-37f2-443a-9cd9-e890aa26debe): created successfully Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fada550e-7c26-434f-933e-73c2c06e3b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (0d2f2c4f-8c8f-49a2-bc5b-0eb69afb03b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:16 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6b7ca175-f9a3-4825-b3b0-31110f330372 tempest-VolumesActionsTest-1152819994 None] Created volume successfully. Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-38cfa650-37f2-443a-9cd9-e890aa26debe-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Lock "cinder-38cfa650-37f2-443a-9cd9-e890aa26debe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Acquiring lock "cinder-quobyte-38cfa650-37f2-443a-9cd9-e890aa26debe" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Lock "cinder-quobyte-38cfa650-37f2-443a-9cd9-e890aa26debe" acquired by "delete_volume" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[27226780-4aa0-4f07-afaf-028fc487017a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:17 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe Apr 15 16:09:17 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:17 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[468f2d21-4c31-49bc-aac2-09e772bb821f]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:18 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe" returned: 0 in 1.141s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:18 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe Apr 15 16:09:18 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:18 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:18 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:18 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-38cfa650-37f2-443a-9cd9-e890aa26debe" returned: 0 in 0.874s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Lock "cinder-quobyte-38cfa650-37f2-443a-9cd9-e890aa26debe" released by "delete_volume" :: held 2.101s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:18 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Created reservations ['2eaea970-eb84-426d-b24d-46063d4ffa34', '8120f991-dd17-4fee-9dc2-e85a6e953f8f', 'bdbfbdd7-67e4-4381-8f18-df5400fc0902', '8f0560c0-e1c8-42d3-9226-c7fe885f5e16'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:19 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 0 in 1.122s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:19 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:19 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:19 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:19 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Flow 'volume_create_manager' (15488e17-3cfb-4ae2-aa80-f236a8f2f7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6fd4c41-b92a-4ee7-a165-a9de155061db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6fd4c41-b92a-4ee7-a165-a9de155061db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1995654932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796f2eaa-f46d-400c-bb9e-e89fa97157e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32307b869fb47e396415e1cbec91d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:19Z,use_quota=True,user_id='7b7eeeabfe324af99b8f3aa4e1723a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6b19f5-27b9-4aae-a044-240281c0e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6b19f5-27b9-4aae-a044-240281c0e034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92702a65-0970-4454-8420-510f1f373bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92702a65-0970-4454-8420-510f1f373bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '796f2eaa-f46d-400c-bb9e-e89fa97157e5', 'volume_name': 'volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d632e1-bf01-418b-ae9e-fbb65ed4f818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d632e1-bf01-418b-ae9e-fbb65ed4f818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e464abf-9570-445a-86a9-3da763599ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:19 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Volume 796f2eaa-f46d-400c-bb9e-e89fa97157e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5', 'volume_size': 1} Apr 15 16:09:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (0228e6ea-205b-4777-a1ef-abf42df8a87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03e6229-e15a-4158-af7e-a5c87e12e379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03e6229-e15a-4158-af7e-a5c87e12e379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354155931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fc2a9a-d70c-4fe1-9993-322a0cc07b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:20Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13033b51-8692-4a3b-b765-fba24f59680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13033b51-8692-4a3b-b765-fba24f59680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9105fae6-1ed7-4ea6-a0b3-0fefc25474b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9105fae6-1ed7-4ea6-a0b3-0fefc25474b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14fc2a9a-d70c-4fe1-9993-322a0cc07b78', 'volume_name': 'volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86509f1-c416-47ab-910c-f212d097caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86509f1-c416-47ab-910c-f212d097caef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aae789b-d0b0-43ac-90bf-11685877193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:20 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Volume 14fc2a9a-d70c-4fe1-9993-322a0cc07b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78', 'volume_size': 1} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:20 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.553s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Deleted volume successfully. Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-06592366-aa09-440f-9a60-5bca0e82fb9b tempest-VolumesActionsTest-1102262053 None] Lock "cinder-38cfa650-37f2-443a-9cd9-e890aa26debe-delete_volume" released by "delete_volume" :: held 3.883s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:20 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 1 in 1.752s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.955s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1995654932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796f2eaa-f46d-400c-bb9e-e89fa97157e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32307b869fb47e396415e1cbec91d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:19Z,use_quota=True,user_id='7b7eeeabfe324af99b8f3aa4e1723a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Creating volume 796f2eaa-f46d-400c-bb9e-e89fa97157e5 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:20 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=80,cinder:UPDATE=92,cinder:DELETE=11,cinder:INSERT=24 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:09:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c', 'name': 'volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23da77f1-9b1b-4310-ae76-246d5e8faa7b', 'enforce_multipath': True} {{(pid=82392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 16:09:20 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 1073741824 Apr 15 16:09:20 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-7b77ba23-b1d2-412e-bc9b-b84c17e5c151 req-259c1fff-f4ef-42e1-8da6-cecf48e60e47 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] attachment_update completed successfully. Apr 15 16:09:21 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 1073741824" returned: 0 in 0.791s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:21 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 Apr 15 16:09:21 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:22 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5" returned: 0 in 0.490s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.745s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354155931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fc2a9a-d70c-4fe1-9993-322a0cc07b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12e80c25144e82adfe09562d27e741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:20Z,use_quota=True,user_id='1a5be52993cb4c96a9da922a447c6f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Creating volume 14fc2a9a-d70c-4fe1-9993-322a0cc07b78 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:22 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e464abf-9570-445a-86a9-3da763599ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63eb1444-ce01-4a33-a1fc-d0190bae01fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:22 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 1073741824 Apr 15 16:09:22 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:22 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Volume volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 (796f2eaa-f46d-400c-bb9e-e89fa97157e5): created successfully Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63eb1444-ce01-4a33-a1fc-d0190bae01fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Flow 'volume_create_manager' (15488e17-3cfb-4ae2-aa80-f236a8f2f7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:22 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-3fb26bcd-4ace-4d7c-a9bd-d61d53abf912 tempest-SnapshotMetadataTestJSON-1559182249 None] Created volume successfully. Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Acquiring lock "cinder-f1757fdd-2703-4ae2-bf53-5e23d1042985-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "cinder-f1757fdd-2703-4ae2-bf53-5e23d1042985-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Acquiring lock "cinder-quobyte-f1757fdd-2703-4ae2-bf53-5e23d1042985" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "cinder-quobyte-f1757fdd-2703-4ae2-bf53-5e23d1042985" acquired by "delete_volume" :: waited 0.023s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e046921-f954-4139-a483-d3cd1844bf6d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:22 devstack sudo[85481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 Apr 15 16:09:22 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:23 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 1073741824" returned: 0 in 1.019s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:23 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 Apr 15 16:09:23 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:23 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985" returned: 0 in 0.754s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:23 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985 Apr 15 16:09:23 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:23 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78" returned: 0 in 0.516s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.831s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aae789b-d0b0-43ac-90bf-11685877193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c230091d-0f1f-48a5-b316-a3d976f9b04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Creating offline snapshot 543c7b3b-b347-4efc-b290-a7a0358fc8cd of volume 796f2eaa-f46d-400c-bb9e-e89fa97157e5 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:09:23 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Volume volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 (14fc2a9a-d70c-4fe1-9993-322a0cc07b78): created successfully Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c230091d-0f1f-48a5-b316-a3d976f9b04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Flow 'volume_create_manager' (0228e6ea-205b-4777-a1ef-abf42df8a87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c64e3a-a40b-4801-bc2f-3d0233f44256]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:23 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-abad4a18-754f-492c-9bdb-137ee0a0f6e3 tempest-VolumesActionsTest-1152819994 None] Created volume successfully. Apr 15 16:09:23 devstack sudo[85491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 Apr 15 16:09:23 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:23 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f1757fdd-2703-4ae2-bf53-5e23d1042985" returned: 0 in 0.473s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "cinder-quobyte-f1757fdd-2703-4ae2-bf53-5e23d1042985" released by "delete_volume" :: held 1.337s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:23 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Created reservations ['1200e3ff-4dba-4115-9b68-d5810b775c41', '672c020d-0529-46bb-82ad-47f778a7704c', '0d3be6cc-60ef-4e92-a69b-59fac6d77dba', '7abf6e83-4fc3-4b9e-8a41-7b2fe34e4d8f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:24 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:24 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:24 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.751s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:24 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Deleted volume successfully. Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e9b0f019-f195-481e-b1ed-0f18282aae9d tempest-ServerRescueNegativeTestJSON-1097995838 None] Lock "cinder-f1757fdd-2703-4ae2-bf53-5e23d1042985-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:24 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5" returned: 0 in 1.060s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:24 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd 1G Apr 15 16:09:24 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "cinder-14fc2a9a-d70c-4fe1-9993-322a0cc07b78-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-14fc2a9a-d70c-4fe1-9993-322a0cc07b78-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "cinder-quobyte-14fc2a9a-d70c-4fe1-9993-322a0cc07b78" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-quobyte-14fc2a9a-d70c-4fe1-9993-322a0cc07b78" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcea561e-33b0-41be-b66b-45f95e7be3cb]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:25 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 Apr 15 16:09:25 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:25 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd 1G" returned: 0 in 0.922s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:25 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd Apr 15 16:09:25 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:25 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78" returned: 0 in 0.778s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:25 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78 Apr 15 16:09:25 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:26 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-14fc2a9a-d70c-4fe1-9993-322a0cc07b78" returned: 0 in 0.918s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-quobyte-14fc2a9a-d70c-4fe1-9993-322a0cc07b78" released by "delete_volume" :: held 1.744s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:26 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:UPDATE=104,cinder:SELECT=85,cinder:INSERT=32,cinder:DELETE=6 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:09:26 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Created reservations ['9d918e2f-4a67-4aa3-a8f9-d684281f1899', '85d71fdb-06eb-48ba-8c1d-74cfde53e09c', 'aef77fd2-0b23-435d-b422-2c346f47df84', 'fa163b4c-176e-4251-9f75-aaa02546ad26'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:27 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:27 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:27 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd" returned: 0 in 1.384s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:27 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd is being set with open permissions: ugo+rw Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:27 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd Apr 15 16:09:27 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:27 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.619s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:27 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Deleted volume successfully. Apr 15 16:09:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7a0111a3-38d2-4a87-884b-e90bfce9bb49 tempest-VolumesActionsTest-1152819994 None] Lock "cinder-14fc2a9a-d70c-4fe1-9993-322a0cc07b78-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:28 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd" returned: 0 in 0.917s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:28 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.info Apr 15 16:09:28 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:29 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.info" returned: 0 in 0.991s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:29 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.info is being set with open permissions: ugo+rw Apr 15 16:09:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:29 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.info Apr 15 16:09:29 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:30 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.info" returned: 0 in 1.038s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.437s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:30 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-9057a90a-b93c-480f-a4bc-0c8447715cfa tempest-SnapshotMetadataTestJSON-1559182249 None] Create snapshot completed successfully Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "cinder-543c7b3b-b347-4efc-b290-a7a0358fc8cd-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-543c7b3b-b347-4efc-b290-a7a0358fc8cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "cinder-quobyte-796f2eaa-f46d-400c-bb9e-e89fa97157e5" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-quobyte-796f2eaa-f46d-400c-bb9e-e89fa97157e5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "cinder-quobyte-543c7b3b-b347-4efc-b290-a7a0358fc8cd" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-quobyte-543c7b3b-b347-4efc-b290-a7a0358fc8cd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Deleting offline snapshot 543c7b3b-b347-4efc-b290-a7a0358fc8cd of volume 796f2eaa-f46d-400c-bb9e-e89fa97157e5 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] snapshot_file for this snap is: volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c908b98a-b5bd-41e2-9acb-bd9117e13344]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:31 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd Apr 15 16:09:31 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:32 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd" returned: 0 in 1.068s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:09:32 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb8e87-39cd-4395-8c9b-157073b4d49e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:32 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 Apr 15 16:09:32 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:33 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5" returned: 0 in 0.519s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:33 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd Apr 15 16:09:33 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:33 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd" returned: 0 in 0.740s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:33 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd Apr 15 16:09:33 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:34 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5.543c7b3b-b347-4efc-b290-a7a0358fc8cd" returned: 0 in 0.577s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-quobyte-543c7b3b-b347-4efc-b290-a7a0358fc8cd" released by "_delete_snapshot" :: held 3.031s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-quobyte-796f2eaa-f46d-400c-bb9e-e89fa97157e5" released by "delete_snapshot" :: held 3.058s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:34 devstack cinder-volume[82392]: WARNING cinder.quota [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:09:34 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Created reservations ['dd5ac996-d1b4-42bc-a671-42cc52977471', '53229da9-937e-4352-9e85-50ebb3e23ce7', '7b01ddec-e1a2-4323-a70a-b8edae8dceb4', 'f92b5394-7c8c-409d-8951-654a0049a24c'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:34 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Delete snapshot completed successfully. Apr 15 16:09:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec5239a-0531-4abe-bb0a-f373b144d919 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-543c7b3b-b347-4efc-b290-a7a0358fc8cd-delete_snapshot" released by "delete_snapshot" :: held 3.213s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:35 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "cinder-796f2eaa-f46d-400c-bb9e-e89fa97157e5-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:35 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-796f2eaa-f46d-400c-bb9e-e89fa97157e5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:35 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "cinder-quobyte-796f2eaa-f46d-400c-bb9e-e89fa97157e5" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:35 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-quobyte-796f2eaa-f46d-400c-bb9e-e89fa97157e5" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:35 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[45807d7e-dc3b-4e34-b714-c452ee5e976d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:35 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 Apr 15 16:09:35 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:36 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5" returned: 0 in 0.712s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:36 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5 Apr 15 16:09:36 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:36 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-796f2eaa-f46d-400c-bb9e-e89fa97157e5" returned: 0 in 0.473s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-quobyte-796f2eaa-f46d-400c-bb9e-e89fa97157e5" released by "delete_volume" :: held 1.223s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:36 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Created reservations ['b83a3c26-8be6-4d99-9b5f-63d98cb10f0c', '81f13182-5ea9-42f7-8d22-d7fa3aba72c4', '49d224a6-e524-4dae-9359-d42b6e711489', '17cd99eb-9edf-40d7-9dc0-45d37c4eafbd'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:37 devstack sudo[85711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:37 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:37 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.496s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:37 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Deleted volume successfully. Apr 15 16:09:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d887c3b6-a636-42e6-8c4e-85cf9b982139 tempest-SnapshotMetadataTestJSON-1559182249 None] Lock "cinder-796f2eaa-f46d-400c-bb9e-e89fa97157e5-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Flow 'volume_create_manager' (1b946fa5-c366-48e4-b0ac-8f1ef74fb99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543a61b4-6fd3-4c96-808d-c2b5a2246e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543a61b4-6fd3-4c96-808d-c2b5a2246e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1018204693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f71244-68a4-4f76-bcae-1e0322b16320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de3ab200aa3492ba9a62900fe8472ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:40Z,use_quota=True,user_id='2cf547064fcc4321a1c55eaf1d9e0921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104c6757-51b1-45a9-8fd4-4f8b19423d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104c6757-51b1-45a9-8fd4-4f8b19423d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eaa591-45ea-4306-9b35-b36d3db397ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eaa591-45ea-4306-9b35-b36d3db397ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f71244-68a4-4f76-bcae-1e0322b16320', 'volume_name': 'volume-68f71244-68a4-4f76-bcae-1e0322b16320', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edc8995-21fa-45b9-ae38-5e08494da268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edc8995-21fa-45b9-ae38-5e08494da268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de4cd1c-7d25-4422-9430-bbcbfbe6e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:39 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Volume 68f71244-68a4-4f76-bcae-1e0322b16320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f71244-68a4-4f76-bcae-1e0322b16320', 'volume_size': 1} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1018204693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f71244-68a4-4f76-bcae-1e0322b16320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de3ab200aa3492ba9a62900fe8472ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:40Z,use_quota=True,user_id='2cf547064fcc4321a1c55eaf1d9e0921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Creating volume 68f71244-68a4-4f76-bcae-1e0322b16320 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:39 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:39 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 1073741824 Apr 15 16:09:39 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:40 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 1073741824" returned: 0 in 0.800s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:40 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 Apr 15 16:09:40 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:40 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Flow 'volume_create_manager' (cd104330-9f8f-498b-853d-9f8e035739c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c71d12-2868-48e4-b64a-c2b183eebba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c71d12-2868-48e4-b64a-c2b183eebba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1083977522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef281a0-7c44-49d3-93ad-77f002fcbb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ed5b8234e1424e856e3cb24c485e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:41Z,use_quota=True,user_id='026538491dbb428db67f4cf36474a85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d72cdb-f625-4cfb-9cd5-6ec5b6c01dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d72cdb-f625-4cfb-9cd5-6ec5b6c01dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa06e76-c12c-4832-8653-07a4c4745a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa06e76-c12c-4832-8653-07a4c4745a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef281a0-7c44-49d3-93ad-77f002fcbb08', 'volume_name': 'volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd7ef63-c61d-4846-a939-eda3a0a073b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd7ef63-c61d-4846-a939-eda3a0a073b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f28cedd-1314-4139-9e59-11f89b1bbf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:41 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Volume 1ef281a0-7c44-49d3-93ad-77f002fcbb08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08', 'volume_size': 1} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:41 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320" returned: 0 in 0.758s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.290s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1083977522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef281a0-7c44-49d3-93ad-77f002fcbb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ed5b8234e1424e856e3cb24c485e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:41Z,use_quota=True,user_id='026538491dbb428db67f4cf36474a85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Creating volume 1ef281a0-7c44-49d3-93ad-77f002fcbb08 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:41 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de4cd1c-7d25-4422-9430-bbcbfbe6e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f71244-68a4-4f76-bcae-1e0322b16320', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc7a719-c175-48d0-893f-58fcc06259ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:41 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Volume volume-68f71244-68a4-4f76-bcae-1e0322b16320 (68f71244-68a4-4f76-bcae-1e0322b16320): created successfully Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc7a719-c175-48d0-893f-58fcc06259ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Flow 'volume_create_manager' (1b946fa5-c366-48e4-b0ac-8f1ef74fb99c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:41 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 1073741824 Apr 15 16:09:41 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0a3e15bf-409b-45db-af1f-e6ff4225fb86 tempest-VolumesMetadataTest-1079660020 None] Created volume successfully. Apr 15 16:09:42 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 1073741824" returned: 0 in 0.767s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:42 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 Apr 15 16:09:42 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Acquiring lock "cinder-68f71244-68a4-4f76-bcae-1e0322b16320-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Lock "cinder-68f71244-68a4-4f76-bcae-1e0322b16320-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Acquiring lock "cinder-quobyte-68f71244-68a4-4f76-bcae-1e0322b16320" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Lock "cinder-quobyte-68f71244-68a4-4f76-bcae-1e0322b16320" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:42 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b89c1c4-c3f5-4ef8-8657-b7ef9a40604e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:42 devstack sudo[85780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 Apr 15 16:09:42 devstack sudo[85780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:43 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08" returned: 0 in 0.797s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f28cedd-1314-4139-9e59-11f89b1bbf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bab661d-5e7b-42fe-8b9d-ca0df4f829bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:43 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Volume volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 (1ef281a0-7c44-49d3-93ad-77f002fcbb08): created successfully Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bab661d-5e7b-42fe-8b9d-ca0df4f829bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Flow 'volume_create_manager' (cd104330-9f8f-498b-853d-9f8e035739c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:43 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-cbd6a0bb-e7d6-4a40-abd2-60806025d4a3 tempest-AbsoluteLimitsTests-707875952 None] Created volume successfully. Apr 15 16:09:43 devstack sudo[85780]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320" returned: 0 in 0.619s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:43 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320 Apr 15 16:09:43 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:43 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-68f71244-68a4-4f76-bcae-1e0322b16320" returned: 0 in 0.525s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Lock "cinder-quobyte-68f71244-68a4-4f76-bcae-1e0322b16320" released by "delete_volume" :: held 1.166s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Created reservations ['81b61af5-8eae-45c6-a5dd-a849692854ec', '7d6e18ac-5491-4230-8e71-f3d73e33579f', '2bb9d670-b3f0-4a44-ba59-61d3d5b887a6', '8df180bd-1d88-4389-945b-6e93133edf11'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Acquiring lock "cinder-1ef281a0-7c44-49d3-93ad-77f002fcbb08-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Lock "cinder-1ef281a0-7c44-49d3-93ad-77f002fcbb08-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:44 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:44 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Acquiring lock "cinder-quobyte-1ef281a0-7c44-49d3-93ad-77f002fcbb08" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Lock "cinder-quobyte-1ef281a0-7c44-49d3-93ad-77f002fcbb08" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2bd228-a2e5-4399-9725-8db657ebab49]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:44 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 Apr 15 16:09:44 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:44 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.523s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:44 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Deleted volume successfully. Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9b4665a2-318e-4d48-8d38-72a05ca8193f tempest-VolumesMetadataTest-1079660020 None] Lock "cinder-68f71244-68a4-4f76-bcae-1e0322b16320-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:44 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08" returned: 0 in 0.670s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:44 devstack sudo[85833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08 Apr 15 16:09:44 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:45 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ef281a0-7c44-49d3-93ad-77f002fcbb08" returned: 0 in 0.839s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Lock "cinder-quobyte-1ef281a0-7c44-49d3-93ad-77f002fcbb08" released by "delete_volume" :: held 1.539s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Created reservations ['20a87c17-bf08-4213-a05d-74c794bcf58f', 'a4757021-f7fd-42a9-97e6-3cfd8d336dad', 'e3a18851-9929-496f-88e2-bc1249aeca68', '08c53eb2-5449-4732-bc53-b853c2fc523c'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:45 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:45 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:46 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.537s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Deleted volume successfully. Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30e004c4-eb60-4545-9c01-db759eb27afe tempest-AbsoluteLimitsTests-707875952 None] Lock "cinder-1ef281a0-7c44-49d3-93ad-77f002fcbb08-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Flow 'volume_create_manager' (69f899b8-7fd1-4802-9ae3-2e15db4f75d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f0652-5413-4f8b-8f0c-097ff1d98a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f0652-5413-4f8b-8f0c-097ff1d98a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-610362304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff3e942-58ea-4f0b-b17f-030de13e3345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2754e81734ad41ef93bb405322260e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:47Z,use_quota=True,user_id='46a0a10e09154a9fab4e9a42eeb86342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b59dc2-66ba-48e3-8cf4-0392a004b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b59dc2-66ba-48e3-8cf4-0392a004b72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060fb2e0-fe32-473e-b742-52cffd9ec0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060fb2e0-fe32-473e-b742-52cffd9ec0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff3e942-58ea-4f0b-b17f-030de13e3345', 'volume_name': 'volume-3ff3e942-58ea-4f0b-b17f-030de13e3345', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63f99b7-151a-44d2-949f-5bc2f1e27167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63f99b7-151a-44d2-949f-5bc2f1e27167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78464793-1151-49e7-944b-00cc88e5437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Volume 3ff3e942-58ea-4f0b-b17f-030de13e3345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff3e942-58ea-4f0b-b17f-030de13e3345', 'volume_size': 1} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-610362304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff3e942-58ea-4f0b-b17f-030de13e3345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2754e81734ad41ef93bb405322260e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:47Z,use_quota=True,user_id='46a0a10e09154a9fab4e9a42eeb86342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Creating volume 3ff3e942-58ea-4f0b-b17f-030de13e3345 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:46 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:46 devstack sudo[85894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 1073741824 Apr 15 16:09:46 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:47 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 1073741824" returned: 0 in 0.978s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:47 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 Apr 15 16:09:47 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:48 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345" returned: 0 in 0.756s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78464793-1151-49e7-944b-00cc88e5437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff3e942-58ea-4f0b-b17f-030de13e3345', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8021a7f1-d57a-4fa6-93a7-4aade29c3c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Volume volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 (3ff3e942-58ea-4f0b-b17f-030de13e3345): created successfully Apr 15 16:09:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8021a7f1-d57a-4fa6-93a7-4aade29c3c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Flow 'volume_create_manager' (69f899b8-7fd1-4802-9ae3-2e15db4f75d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-3e9ed714-f9a3-4e32-a78b-16d014d5c198 req-e42a468c-825a-4265-8b66-8051f611f5af tempest-VolumesSnapshotsTestJSON-1431189217 None] Created volume successfully. Apr 15 16:09:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Creating offline snapshot 914a09f8-0357-4649-a60e-715a70385d35 of volume 3ff3e942-58ea-4f0b-b17f-030de13e3345 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:09:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecdc8f4-210e-4745-b6e9-e5a905076d95]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:49 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 Apr 15 16:09:49 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:49 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345" returned: 0 in 0.805s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:49 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 1G Apr 15 16:09:49 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:50 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 1G" returned: 0 in 0.627s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:50 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 Apr 15 16:09:50 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:51 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35" returned: 0 in 0.653s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:51 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 is being set with open permissions: ugo+rw Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:51 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 Apr 15 16:09:51 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Flow 'volume_create_manager' (4fae5b4a-368c-4a34-b4f6-b38464bd215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ce9e95-13e2-4866-b1e9-07920395afea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ce9e95-13e2-4866-b1e9-07920395afea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1597716696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940c884d-fb2c-4628-bee5-e1b6ee7501bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870c1583c59428ea0b371413b6b3f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:52Z,use_quota=True,user_id='29a41ae93db94b04806c9a19bc74ac47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f357ca8-218f-4f87-b090-b62b50970e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f357ca8-218f-4f87-b090-b62b50970e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c977ab4-6ed2-4206-8be2-543fb4939d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c977ab4-6ed2-4206-8be2-543fb4939d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940c884d-fb2c-4628-bee5-e1b6ee7501bc', 'volume_name': 'volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657f04db-5b6a-4aa5-979e-af2333a8ce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657f04db-5b6a-4aa5-979e-af2333a8ce08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d7be94-a4e3-4c8b-8835-9be7ec9a19c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:51 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Volume 940c884d-fb2c-4628-bee5-e1b6ee7501bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc', 'volume_size': 1} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:51 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35" returned: 0 in 0.613s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:51 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.info Apr 15 16:09:51 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:52 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:52 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-93f5ee4c-4c99-4925-8a45-5cf367141225 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Terminate volume connection completed successfully. Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-93f5ee4c-4c99-4925-8a45-5cf367141225 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Deleting attachment 23da77f1-9b1b-4310-ae76-246d5e8faa7b. {{(pid=82392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.info" returned: 0 in 0.499s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:52 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.info is being set with open permissions: ugo+rw Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:52 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.info Apr 15 16:09:52 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:52 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.info" returned: 0 in 0.498s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.787s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.075s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1597716696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940c884d-fb2c-4628-bee5-e1b6ee7501bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870c1583c59428ea0b371413b6b3f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:52Z,use_quota=True,user_id='29a41ae93db94b04806c9a19bc74ac47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Creating volume 940c884d-fb2c-4628-bee5-e1b6ee7501bc {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:52 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:52 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc 1073741824 Apr 15 16:09:52 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:52 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-fc2d9ae8-a105-4b59-8563-3741c79eec2e req-ad382766-67e8-42e0-9696-40081c63d52b tempest-VolumesSnapshotsTestJSON-1431189217 None] Create snapshot completed successfully Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "cinder-02abae76-0ebe-48c1-b259-bf063a9a2d6a-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "cinder-02abae76-0ebe-48c1-b259-bf063a9a2d6a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "cinder-quobyte-02abae76-0ebe-48c1-b259-bf063a9a2d6a" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "cinder-quobyte-02abae76-0ebe-48c1-b259-bf063a9a2d6a" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[64baefe5-8c20-4be8-9c39-f7448b0c7dfa]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:53 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:53 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:53 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc 1073741824" returned: 0 in 0.663s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:53 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 0 in 0.555s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:53 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc Apr 15 16:09:53 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:53 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:53 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "cinder-914a09f8-0357-4649-a60e-715a70385d35-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-914a09f8-0357-4649-a60e-715a70385d35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "cinder-quobyte-3ff3e942-58ea-4f0b-b17f-030de13e3345" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-quobyte-3ff3e942-58ea-4f0b-b17f-030de13e3345" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "cinder-quobyte-914a09f8-0357-4649-a60e-715a70385d35" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-quobyte-914a09f8-0357-4649-a60e-715a70385d35" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Deleting offline snapshot 914a09f8-0357-4649-a60e-715a70385d35 of volume 3ff3e942-58ea-4f0b-b17f-030de13e3345 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] snapshot_file for this snap is: volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bde23d9-25de-4abd-8abe-5068b2baad84]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:54 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc" returned: 0 in 0.480s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d7be94-a4e3-4c8b-8835-9be7ec9a19c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd28043f-07f7-4482-9d69-a869fba73142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:54 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Volume volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc (940c884d-fb2c-4628-bee5-e1b6ee7501bc): created successfully Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd28043f-07f7-4482-9d69-a869fba73142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Flow 'volume_create_manager' (4fae5b4a-368c-4a34-b4f6-b38464bd215f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:54 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6460f944-c579-477d-8d61-d4ef8b3b94c3 tempest-VolumesTransfersV357Test-1540077023 None] Created volume successfully. Apr 15 16:09:54 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 Apr 15 16:09:54 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:54 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 1 in 0.662s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:54 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a Apr 15 16:09:54 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:54 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35" returned: 0 in 0.683s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ff3e942-58ea-4f0b-b17f-030de13e3345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd0fe1b-9dad-4bf2-b5e7-2b377ae8574f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:54 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-02abae76-0ebe-48c1-b259-bf063a9a2d6a" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "cinder-quobyte-02abae76-0ebe-48c1-b259-bf063a9a2d6a" released by "delete_volume" :: held 1.726s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:54 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 Apr 15 16:09:54 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.quota [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Created reservations ['c8ce0f83-e51b-4e51-a676-b7782a070e15', 'a20369fe-c72e-4bee-9eff-c5fd902570db', 'e071ce42-9878-42b1-b80f-c9e5baeb178e', '0df678c4-e161-4eca-af8b-d1a144ca4638'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:54 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:54 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:55 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-96639b69-6910-4d73-ba9a-3d63953dc2fa tempest-VolumesTransfersV357Test-711025565 None] Transfer volume completed successfully. Apr 15 16:09:55 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.514s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:55 devstack cinder-volume[82392]: DEBUG cinder.manager [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:55 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Deleted volume successfully. Apr 15 16:09:55 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345" returned: 0 in 0.697s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f2e22caf-0233-4a38-b459-c3cac9f076de req-09e3fd4d-1e83-493c-912e-28ca24175c5a tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "cinder-02abae76-0ebe-48c1-b259-bf063a9a2d6a-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:55 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 Apr 15 16:09:55 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:55 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35" returned: 0 in 0.539s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:55 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35 Apr 15 16:09:55 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Acquiring lock "cinder-940c884d-fb2c-4628-bee5-e1b6ee7501bc-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Lock "cinder-940c884d-fb2c-4628-bee5-e1b6ee7501bc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Acquiring lock "cinder-quobyte-940c884d-fb2c-4628-bee5-e1b6ee7501bc" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Lock "cinder-quobyte-940c884d-fb2c-4628-bee5-e1b6ee7501bc" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d23528-00ce-4d0a-a32f-87ee3e4e317c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:56 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc Apr 15 16:09:56 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:56 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345.914a09f8-0357-4649-a60e-715a70385d35" returned: 0 in 0.520s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-quobyte-914a09f8-0357-4649-a60e-715a70385d35" released by "_delete_snapshot" :: held 2.518s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-quobyte-3ff3e942-58ea-4f0b-b17f-030de13e3345" released by "delete_snapshot" :: held 2.547s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG cinder.quota [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Created reservations ['4e9d64ce-c612-497c-b232-44ed9d2c0470', '44004141-edc7-46d6-8396-86251e792a26', 'ed843b06-909b-48fd-a8b3-8ad03f4b7550', '1a3caf51-442a-485c-bd83-c88cdb6667fd'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:56 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Delete snapshot completed successfully. Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-f1422f06-4aa0-4364-8f9e-22431ea625a5 req-92d808b9-1c15-48b5-83f9-c4d8c7eb0eab tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-914a09f8-0357-4649-a60e-715a70385d35-delete_snapshot" released by "delete_snapshot" :: held 2.697s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:56 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc" returned: 0 in 0.664s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:56 devstack sudo[86009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc Apr 15 16:09:56 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "cinder-3ff3e942-58ea-4f0b-b17f-030de13e3345-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-3ff3e942-58ea-4f0b-b17f-030de13e3345-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "cinder-quobyte-3ff3e942-58ea-4f0b-b17f-030de13e3345" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-quobyte-3ff3e942-58ea-4f0b-b17f-030de13e3345" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdc7435-78aa-41eb-9966-d91d14130327]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:57 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 Apr 15 16:09:57 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:57 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-940c884d-fb2c-4628-bee5-e1b6ee7501bc" returned: 0 in 0.609s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Lock "cinder-quobyte-940c884d-fb2c-4628-bee5-e1b6ee7501bc" released by "delete_volume" :: held 1.305s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Created reservations ['6feafc8c-3999-40ab-b2fe-de20a1f88f15', '3eeb5231-5041-4557-9a5f-b26d6f2f57eb', 'c9a2b82e-9d5a-4b3e-8fcd-ccee8ce843ab', '63c55cc4-45f1-49b0-af2e-de845b5c4d48'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:57 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:57 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:58 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345" returned: 0 in 0.758s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:58 devstack sudo[86044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345 Apr 15 16:09:58 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:58 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Flow 'volume_create_manager' (cdba255c-62a1-4b04-8f5b-311bbc0c106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7777b4-86db-45b5-b7e6-7b61acb12716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.553s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7777b4-86db-45b5-b7e6-7b61acb12716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1469040716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37bc79e-42a5-4c55-90f6-7a25df91d724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f348222c87bd4122ae97d44cf2f9f114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:58Z,use_quota=True,user_id='8b63fd54225a4485a9f04647a35428c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1da701-fc6d-4cda-99a1-70b41fceca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1da701-fc6d-4cda-99a1-70b41fceca29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd49ffb-feef-49df-a5d5-c4b488b1f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd49ffb-feef-49df-a5d5-c4b488b1f336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c37bc79e-42a5-4c55-90f6-7a25df91d724', 'volume_name': 'volume-c37bc79e-42a5-4c55-90f6-7a25df91d724', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc6fd50-0acd-422a-9f1b-5463f45173b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc6fd50-0acd-422a-9f1b-5463f45173b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5416d9-063c-4f9e-9bd3-c254ce62337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Volume c37bc79e-42a5-4c55-90f6-7a25df91d724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c37bc79e-42a5-4c55-90f6-7a25df91d724', 'volume_size': 1} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1469040716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37bc79e-42a5-4c55-90f6-7a25df91d724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f348222c87bd4122ae97d44cf2f9f114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:58Z,use_quota=True,user_id='8b63fd54225a4485a9f04647a35428c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Creating volume c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:58 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:58 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Deleted volume successfully. Apr 15 16:09:58 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 1073741824 Apr 15 16:09:58 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5d2edf7d-45db-4d7d-93cb-88a00b8a9d97 tempest-VolumesTransfersV357Test-631262578 None] Lock "cinder-940c884d-fb2c-4628-bee5-e1b6ee7501bc-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:58 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3ff3e942-58ea-4f0b-b17f-030de13e3345" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-quobyte-3ff3e942-58ea-4f0b-b17f-030de13e3345" released by "delete_volume" :: held 1.280s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.quota [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Created reservations ['192a23c1-93c6-40bc-a15e-2b24d6a991e7', 'fe23e77b-09bb-4880-9b4e-c5a3f4c9ed70', '3c3112e7-5a75-44d8-b8af-08a85bcef91e', '6d5303a4-f90c-4bdd-a947-ba64931e31ee'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:58 devstack sudo[86053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:09:58 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Flow 'volume_create_manager' (86b9bdff-cd23-49b5-a7f5-f650b3a9c32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec5024a-d4f5-4483-b0c5-9e0ef8f472b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec5024a-d4f5-4483-b0c5-9e0ef8f472b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-82622435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71b5ebc-1cd3-4d8b-aac1-d236dc83238b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870c1583c59428ea0b371413b6b3f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:59Z,use_quota=True,user_id='29a41ae93db94b04806c9a19bc74ac47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2748230c-a7ee-450c-b175-f39b87bc34c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2748230c-a7ee-450c-b175-f39b87bc34c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a37d51f-220d-4dee-827f-36bd5addede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a37d51f-220d-4dee-827f-36bd5addede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71b5ebc-1cd3-4d8b-aac1-d236dc83238b', 'volume_name': 'volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c383ac05-3a39-4251-ad54-ea63b8835225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c383ac05-3a39-4251-ad54-ea63b8835225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60766a7-66c0-4c3d-be66-26d2b1a60b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:58 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Volume d71b5ebc-1cd3-4d8b-aac1-d236dc83238b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b', 'volume_size': 1} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:58 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 1073741824" returned: 0 in 0.638s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:58 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:09:58 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:59 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.manager [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:09:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Deleted volume successfully. Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-d511bb3a-da94-4f52-91b6-eab35b393270 req-bcb44a78-e7fa-4fc4-84cf-9d19e6f70cc3 tempest-VolumesSnapshotsTestJSON-1431189217 None] Lock "cinder-3ff3e942-58ea-4f0b-b17f-030de13e3345-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:09:59 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.432s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-82622435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71b5ebc-1cd3-4d8b-aac1-d236dc83238b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870c1583c59428ea0b371413b6b3f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:09:59Z,use_quota=True,user_id='29a41ae93db94b04806c9a19bc74ac47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Creating volume d71b5ebc-1cd3-4d8b-aac1-d236dc83238b {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:09:59 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5416d9-063c-4f9e-9bd3-c254ce62337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37bc79e-42a5-4c55-90f6-7a25df91d724', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7be9522-7e68-4502-b424-a3af5da4f0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:09:59 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b 1073741824 Apr 15 16:09:59 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:09:59 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Volume volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 (c37bc79e-42a5-4c55-90f6-7a25df91d724): created successfully Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7be9522-7e68-4502-b424-a3af5da4f0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Flow 'volume_create_manager' (cdba255c-62a1-4b04-8f5b-311bbc0c106a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:09:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-54b70350-4a1b-4247-b7f4-3af9b10166cd tempest-VolumesActionsTest-1176014197 None] Created volume successfully. Apr 15 16:09:59 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b 1073741824" returned: 0 in 0.629s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:09:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:09:59 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b Apr 15 16:09:59 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:00 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b" returned: 0 in 0.525s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:10:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60766a7-66c0-4c3d-be66-26d2b1a60b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27459fe6-2095-4d76-8043-edcb7213b8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Volume volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b (d71b5ebc-1cd3-4d8b-aac1-d236dc83238b): created successfully Apr 15 16:10:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27459fe6-2095-4d76-8043-edcb7213b8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Flow 'volume_create_manager' (86b9bdff-cd23-49b5-a7f5-f650b3a9c32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:00 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-afca5ee8-ac1e-4f89-9511-cc1d8c543d9d tempest-VolumesTransfersV357Test-1540077023 None] Created volume successfully. Apr 15 16:10:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Acquiring lock "cinder-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Lock "cinder-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Acquiring lock "cinder-quobyte-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Lock "cinder-quobyte-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:01 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41071dd-ed96-448f-aaf1-8d11e76416ff]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:01 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b Apr 15 16:10:01 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:01 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b" returned: 0 in 0.601s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:01 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b Apr 15 16:10:01 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Flow 'volume_create_manager' (a34e1eac-bda2-494a-9f29-d2eb3bae19c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b50c875-8701-40be-b13c-5e45a0c365b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b50c875-8701-40be-b13c-5e45a0c365b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-248315997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2340bbea-0988-4981-8469-30c11c12e346,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='45407d3a0e0242df845b57891d6a295f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:02Z,use_quota=True,user_id='3528ce273f3245a48720d5d67904bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b423b0-61f5-4619-bff9-c6191ffb881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b423b0-61f5-4619-bff9-c6191ffb881e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c05da9-a13c-47ed-af46-10f0bd080fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c05da9-a13c-47ed-af46-10f0bd080fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2340bbea-0988-4981-8469-30c11c12e346', 'volume_name': 'volume-2340bbea-0988-4981-8469-30c11c12e346', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412226d5-9060-4dec-9650-ce245349f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412226d5-9060-4dec-9650-ce245349f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41997f5c-d7de-4296-bcb8-5ac7f37b3298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:02 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Volume 2340bbea-0988-4981-8469-30c11c12e346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2340bbea-0988-4981-8469-30c11c12e346', 'volume_size': 1} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-248315997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2340bbea-0988-4981-8469-30c11c12e346,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='45407d3a0e0242df845b57891d6a295f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:02Z,use_quota=True,user_id='3528ce273f3245a48720d5d67904bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Creating volume 2340bbea-0988-4981-8469-30c11c12e346 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:10:02 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:02 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 1073741824 Apr 15 16:10:02 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:02 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b" returned: 0 in 0.563s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Lock "cinder-quobyte-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b" released by "delete_volume" :: held 1.196s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Created reservations ['6b334234-c003-42d6-b4c9-edf1bec16660', 'e1305dfe-bcb9-4fbf-a5dc-e61d70629f4e', '2a6d7b14-f9e2-4423-a567-c431d915c4ea', 'eaf6bd91-c94a-4f6e-8170-98d5aad9cbb1'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:02 devstack sudo[86086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:10:02 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:02 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 1073741824" returned: 0 in 0.513s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:02 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 Apr 15 16:10:02 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:02 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:02 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:10:02 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Deleted volume successfully. Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-27ce665a-787a-4951-8c76-41930be1632c tempest-VolumesTransfersV357Test-631262578 None] Lock "cinder-d71b5ebc-1cd3-4d8b-aac1-d236dc83238b-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:03 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346" returned: 0 in 0.446s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41997f5c-d7de-4296-bcb8-5ac7f37b3298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2340bbea-0988-4981-8469-30c11c12e346', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1359103e-0bcd-40c4-b9e4-c72e2e1dece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:03 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Volume volume-2340bbea-0988-4981-8469-30c11c12e346 (2340bbea-0988-4981-8469-30c11c12e346): created successfully Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1359103e-0bcd-40c4-b9e4-c72e2e1dece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Flow 'volume_create_manager' (a34e1eac-bda2-494a-9f29-d2eb3bae19c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:03 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-42348026-a415-4294-9e4d-32c4cd27d6fb req-16830b82-08f3-4b2d-86b2-cf6427cd8a3d tempest-VolumesGetTestJSON-1050021391 None] Created volume successfully. Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:03 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:10:03 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:04 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.570s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:10:04 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Acquiring lock "cinder-2340bbea-0988-4981-8469-30c11c12e346-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:04 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Lock "cinder-2340bbea-0988-4981-8469-30c11c12e346-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:04 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Acquiring lock "cinder-quobyte-2340bbea-0988-4981-8469-30c11c12e346" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:04 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Lock "cinder-quobyte-2340bbea-0988-4981-8469-30c11c12e346" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:04 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbabe9c-bf50-4884-9173-42489005f9a7]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:04 devstack sudo[86122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 Apr 15 16:10:04 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:05 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346" returned: 0 in 0.602s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:05 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346 Apr 15 16:10:05 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:05 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2340bbea-0988-4981-8469-30c11c12e346" returned: 0 in 0.487s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Lock "cinder-quobyte-2340bbea-0988-4981-8469-30c11c12e346" released by "delete_volume" :: held 1.121s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG cinder.quota [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Created reservations ['bb5f4037-a072-40f3-a1f1-b8fdb3fe4869', 'b327f38b-c947-4534-a0eb-09a6d1ca9b31', 'e2287571-31d9-44c6-bb57-1f373d66bbeb', 'f4b7c4a4-b4b1-4aa0-add2-172f5f985261'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:05 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:10:05 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:06 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.544s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:06 devstack cinder-volume[82392]: DEBUG cinder.manager [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:10:06 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Deleted volume successfully. Apr 15 16:10:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-8d9ed8f8-e28d-40c2-86b2-48d7f829f8e9 req-5c0a3df3-bd21-4a61-b131-9e99c49a6f16 tempest-VolumesGetTestJSON-1050021391 None] Lock "cinder-2340bbea-0988-4981-8469-30c11c12e346-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:07 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-3268b21a-6e5a-4f41-8f2d-a55314aa280b tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Terminate volume connection completed successfully. Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-3268b21a-6e5a-4f41-8f2d-a55314aa280b tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Deleting attachment 711308e7-17b4-4071-ba4f-060f2642eb3c. {{(pid=82392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Flow 'volume_create_manager' (e12428d5-a16e-40f0-b17a-653c59bb9fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6592b92e-af62-4494-bc09-842e2d9eb822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6592b92e-af62-4494-bc09-842e2d9eb822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-817793445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04ae4eb-da32-4b26-8dc2-7bea184f6d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91381a8cb2f4a13abae3fabb7e75af2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:08Z,use_quota=True,user_id='23185fa1909749b8bac4f1ad19a3b8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0243b1d5-a2da-40ef-974a-c78ab99c282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0243b1d5-a2da-40ef-974a-c78ab99c282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6535759a-9b85-4bee-8bbe-275fb284b265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6535759a-9b85-4bee-8bbe-275fb284b265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04ae4eb-da32-4b26-8dc2-7bea184f6d3d', 'volume_name': 'volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fa06e5-f481-4163-8a28-e4e1e452de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fa06e5-f481-4163-8a28-e4e1e452de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a3e90f-d1f5-4a5c-8e5e-1f7566b2a5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:07 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Volume e04ae4eb-da32-4b26-8dc2-7bea184f6d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d', 'volume_size': 1} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-817793445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04ae4eb-da32-4b26-8dc2-7bea184f6d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91381a8cb2f4a13abae3fabb7e75af2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:08Z,use_quota=True,user_id='23185fa1909749b8bac4f1ad19a3b8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Creating volume e04ae4eb-da32-4b26-8dc2-7bea184f6d3d {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:10:07 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:07 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d 1073741824 Apr 15 16:10:07 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "cinder-596f5e60-fa2d-40cc-ab0a-a4311a38023a-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "cinder-596f5e60-fa2d-40cc-ab0a-a4311a38023a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "cinder-quobyte-596f5e60-fa2d-40cc-ab0a-a4311a38023a" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "cinder-quobyte-596f5e60-fa2d-40cc-ab0a-a4311a38023a" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e2b58d-d4a8-4a20-a5be-0bd183fb7849]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:08 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a Apr 15 16:10:08 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:08 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d 1073741824" returned: 0 in 0.655s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:08 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d Apr 15 16:10:08 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:08 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a" returned: 0 in 0.712s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:08 devstack sudo[86168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a Apr 15 16:10:08 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:09 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d" returned: 0 in 0.589s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a3e90f-d1f5-4a5c-8e5e-1f7566b2a5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db194597-5eb8-4d8a-82bf-a2d5e77e683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:09 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Volume volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d (e04ae4eb-da32-4b26-8dc2-7bea184f6d3d): created successfully Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db194597-5eb8-4d8a-82bf-a2d5e77e683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Flow 'volume_create_manager' (e12428d5-a16e-40f0-b17a-653c59bb9fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:09 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-98c4e217-75b2-4c0e-9e5c-f53b7ee4abfa tempest-VolumesNegativeTest-1257301131 None] Created volume successfully. Apr 15 16:10:09 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-596f5e60-fa2d-40cc-ab0a-a4311a38023a" returned: 0 in 0.502s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "cinder-quobyte-596f5e60-fa2d-40cc-ab0a-a4311a38023a" released by "delete_volume" :: held 1.242s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.quota [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Created reservations ['7f705c60-04c8-48fc-b974-3649c3f7b7e0', '09fc1153-7c75-4108-88a6-c3a800f287a9', 'ba359e36-63f3-46d7-83a2-181663a4ca94', 'b186ffdc-6b07-4e66-ac51-630c911bfb50'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:09 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:10:09 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:09 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.481s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.manager [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:10:09 devstack cinder-volume[82392]: INFO cinder.volume.manager [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Deleted volume successfully. Apr 15 16:10:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [req-aa3a9997-49b6-45a7-9885-93d93a70b5d9 req-f776b560-6702-4d3c-831c-dbf81f1a50b0 tempest-ServerBootFromVolumeStableRescueTest-575179876 None] Lock "cinder-596f5e60-fa2d-40cc-ab0a-a4311a38023a-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2a40cfe9-c1a6-4fe1-91dd-9542960193e7 tempest-BackendsCapabilitiesAdminTestsJSON-99457679 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7265129089355, 'free_capacity_gb': 1775.7265129089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82392) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 16:10:11 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1cfecee3-be96-4780-a40e-d608259aa992 tempest-BackendsCapabilitiesAdminTestsJSON-99457679 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7265129089355, 'free_capacity_gb': 1775.7265129089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82392) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 16:10:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5b005f8b-3806-4764-861f-f2709d273994 tempest-VolumesActionsTest-1176014197 None] Acquiring lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724" by "attach_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5b005f8b-3806-4764-861f-f2709d273994 tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724" acquired by "attach_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5b005f8b-3806-4764-861f-f2709d273994 tempest-VolumesActionsTest-1176014197 None] Attaching volume c37bc79e-42a5-4c55-90f6-7a25df91d724 to instance 4037e18c-6c93-450d-b230-893d7bcdeafa at mountpoint /dev/vdb on host None. Apr 15 16:10:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5b005f8b-3806-4764-861f-f2709d273994 tempest-VolumesActionsTest-1176014197 None] Attach volume completed successfully. Apr 15 16:10:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5b005f8b-3806-4764-861f-f2709d273994 tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724" released by "attach_volume" :: held 0.085s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2fb1f815-f53f-4141-9dd4-02b210ba75b6 tempest-VolumesActionsTest-1176014197 None] Acquiring lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-detach_volume" by "detach_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2fb1f815-f53f-4141-9dd4-02b210ba75b6 tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:15 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2fb1f815-f53f-4141-9dd4-02b210ba75b6 tempest-VolumesActionsTest-1176014197 None] Detaching volume c37bc79e-42a5-4c55-90f6-7a25df91d724 from instance 4037e18c-6c93-450d-b230-893d7bcdeafa. Apr 15 16:10:15 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2fb1f815-f53f-4141-9dd4-02b210ba75b6 tempest-VolumesActionsTest-1176014197 None] Detach volume completed successfully. Apr 15 16:10:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2fb1f815-f53f-4141-9dd4-02b210ba75b6 tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-92d345bb-0da8-4950-b868-b89937cfc20f tempest-GroupsV314Test-725400122 None] Group tempest-GroupsV314Test-Group-1267738011: creating Apr 15 16:10:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-92d345bb-0da8-4950-b868-b89937cfc20f tempest-GroupsV314Test-725400122 None] Group tempest-GroupsV314Test-Group-1267738011: created successfully Apr 15 16:10:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-92d345bb-0da8-4950-b868-b89937cfc20f tempest-GroupsV314Test-725400122 None] Create group completed successfully. Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=114,cinder:INSERT=30,cinder:UPDATE=134,cinder:DELETE=10 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Flow 'volume_create_manager' (c3815bc7-fc99-443e-b82a-6c1bfdbe321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4e54dd-6643-4bcb-8cfb-184e9f74b080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4e54dd-6643-4bcb-8cfb-184e9f74b080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589201979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c40bbab5-9f93-4f74-bb46-1dcbb685f3d6,host='devstack@QuobyteHD#QuobyteHD',id=23c8f518-d9c5-4d05-bc38-12332ff0d1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37b06656c594589ade70d211f6e3dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:22Z,use_quota=True,user_id='b41c6a580a284546820d919d85a812ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f703bf64-3af6-4e30-a8e8-d720a493e258),volume_type_id=f703bf64-3af6-4e30-a8e8-d720a493e258)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd483cb-2242-49c8-b068-86fa4e289306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd483cb-2242-49c8-b068-86fa4e289306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2c5b5b-d627-442c-a91d-3bb9b98af7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2c5b5b-d627-442c-a91d-3bb9b98af7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c8f518-d9c5-4d05-bc38-12332ff0d1fd', 'volume_name': 'volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c640960d-7f1a-493b-93b4-88ddf6732cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c640960d-7f1a-493b-93b4-88ddf6732cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33988a7e-53be-4a1e-bfab-c174af7e2ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:21 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Volume 23c8f518-d9c5-4d05-bc38-12332ff0d1fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd', 'volume_size': 1} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c40bbab5-9f93-4f74-bb46-1dcbb685f3d6,created_at=2026-04-15T14:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589201979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c40bbab5-9f93-4f74-bb46-1dcbb685f3d6,host='devstack@QuobyteHD#QuobyteHD',id=23c8f518-d9c5-4d05-bc38-12332ff0d1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37b06656c594589ade70d211f6e3dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:22Z,use_quota=True,user_id='b41c6a580a284546820d919d85a812ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f703bf64-3af6-4e30-a8e8-d720a493e258),volume_type_id=f703bf64-3af6-4e30-a8e8-d720a493e258)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Creating volume 23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:10:21 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:10:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:21 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd 1073741824 Apr 15 16:10:21 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:22 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd 1073741824" returned: 0 in 0.845s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:22 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd Apr 15 16:10:22 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:23 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" returned: 0 in 0.693s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:10:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33988a7e-53be-4a1e-bfab-c174af7e2ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49386cac-95d0-4b9a-a017-9fbed9d77749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:23 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Volume volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd (23c8f518-d9c5-4d05-bc38-12332ff0d1fd): created successfully Apr 15 16:10:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49386cac-95d0-4b9a-a017-9fbed9d77749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Flow 'volume_create_manager' (c3815bc7-fc99-443e-b82a-6c1bfdbe321d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:23 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-17bbae75-0b17-4bbd-b35d-0f751181f1f8 tempest-GroupsV314Test-725400122 None] Created volume successfully. Apr 15 16:10:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:24 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Cloning volume 23c8f518-d9c5-4d05-bc38-12332ff0d1fd to volume c4c1639b-cf54-4612-a9d9-9fde46dad188 Apr 15 16:10:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Creating offline snapshot f99f9b58-274c-4742-b3b9-48f42898a9d4 of volume 23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:10:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd385cf1-1ad1-4a17-a657-911f93e6a909]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:25 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd Apr 15 16:10:25 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:25 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" returned: 0 in 0.568s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:25 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 1G Apr 15 16:10:25 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:26 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 1G" returned: 0 in 0.675s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:26 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 Apr 15 16:10:26 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:26 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4" returned: 0 in 0.552s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:26 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:10:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:26 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 Apr 15 16:10:26 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:27 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4" returned: 0 in 0.598s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:27 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=89,cinder:INSERT=33,cinder:UPDATE=129,cinder:DELETE=12 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:10:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:27 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.info Apr 15 16:10:27 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:28 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.info" returned: 0 in 0.526s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:28 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:28 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.info Apr 15 16:10:28 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:28 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.info" returned: 0 in 0.554s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Acquiring lock "cinder-quobyte-c4c1639b-cf54-4612-a9d9-9fde46dad188" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Lock "cinder-quobyte-c4c1639b-cf54-4612-a9d9-9fde46dad188" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] snapshot: f99f9b58-274c-4742-b3b9-48f42898a9d4, volume: c4c1639b-cf54-4612-a9d9-9fde46dad188, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffad918-c801-49c6-9f50-e4df95f7d986]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:28 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 Apr 15 16:10:28 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:29 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4" returned: 0 in 0.603s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a77469-6539-4827-bd17-42fc6f0d6e4d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:29 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd Apr 15 16:10:29 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:29 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" returned: 0 in 0.616s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:10:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:29 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 Apr 15 16:10:29 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:32 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188" returned: 0 in 3.137s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:33 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea02b29-755f-48da-9a83-756d5c8c4e04]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:33 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd Apr 15 16:10:33 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:33 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" returned: 0 in 0.774s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:33 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd, size 1024.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:10:33 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Converted 1024.00 MB image at 326.35 MB/s Apr 15 16:10:33 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:10:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:33 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 Apr 15 16:10:33 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:34 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188" returned: 0 in 0.519s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Lock "cinder-quobyte-c4c1639b-cf54-4612-a9d9-9fde46dad188" released by "_copy_volume_from_snapshot" :: held 5.717s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Acquiring lock "cinder-quobyte-f99f9b58-274c-4742-b3b9-48f42898a9d4" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Lock "cinder-quobyte-f99f9b58-274c-4742-b3b9-48f42898a9d4" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Deleting offline snapshot f99f9b58-274c-4742-b3b9-48f42898a9d4 of volume 23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] snapshot_file for this snap is: volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d409c79-3588-46b9-9b16-3f3c7e21aed1]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:34 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 Apr 15 16:10:34 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:34 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4" returned: 0 in 0.564s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[165e7bec-dd9b-40a6-a2fc-85de44f70c6a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:34 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd Apr 15 16:10:34 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:35 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" returned: 0 in 0.608s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:35 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 Apr 15 16:10:35 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:36 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4" returned: 0 in 0.472s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:36 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4 Apr 15 16:10:36 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:36 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd.f99f9b58-274c-4742-b3b9-48f42898a9d4" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Lock "cinder-quobyte-f99f9b58-274c-4742-b3b9-48f42898a9d4" released by "_delete_snapshot" :: held 2.168s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.515s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:36 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1bc33a80-3d2d-4f65-b39e-c4ff11eb94b2 tempest-GroupsV314Test-725400122 None] Create group from source-group-c40bbab5-9f93-4f74-bb46-1dcbb685f3d6 completed successfully. Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Acquiring lock "cinder-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Lock "cinder-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Acquiring lock "cinder-quobyte-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Lock "cinder-quobyte-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d" acquired by "delete_volume" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[178b9f90-2452-4ddc-b9ab-85313a3947c5]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:37 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d Apr 15 16:10:37 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Acquiring lock "cinder-quobyte-c4c1639b-cf54-4612-a9d9-9fde46dad188" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Lock "cinder-quobyte-c4c1639b-cf54-4612-a9d9-9fde46dad188" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1fd72-4c3e-48ae-8ad9-d6d782310379]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:37 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 Apr 15 16:10:37 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:37 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d" returned: 0 in 0.543s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:37 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d Apr 15 16:10:37 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:38 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188" returned: 0 in 0.745s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:38 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188 Apr 15 16:10:38 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:38 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d" returned: 0 in 0.681s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Lock "cinder-quobyte-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d" released by "delete_volume" :: held 1.259s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Created reservations ['659b956b-e86e-46ce-838e-082af8fe8d2c', '9d6159fa-f4f5-4793-b6cf-130147f6b820', 'a35fd514-de28-4251-87ca-6358d86f6443', 'e0950cae-ac7f-4521-ab1d-e24d62a3cd38'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:38 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:10:38 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:39 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.851s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:10:39 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Deleted volume successfully. Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30b501aa-bf3a-4f2d-b9c6-adcf82185e8a tempest-VolumesNegativeTest-1257301131 None] Lock "cinder-e04ae4eb-da32-4b26-8dc2-7bea184f6d3d-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:39 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c4c1639b-cf54-4612-a9d9-9fde46dad188" returned: 0 in 1.239s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Lock "cinder-quobyte-c4c1639b-cf54-4612-a9d9-9fde46dad188" released by "delete_volume" :: held 2.009s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Created reservations ['8a105fd3-f014-45f7-bc18-d2b55133b728'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:10:39 devstack cinder-volume[82392]: WARNING cinder.quota [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-820137210 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-820137210, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:10:39 devstack cinder-volume[82392]: WARNING cinder.quota [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-820137210 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-820137210, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Created reservations ['d751538d-1f0c-4473-8975-5beb13b794f6', 'f9532784-423a-438b-b6e4-e6a19c3e24e7', '89ca9ae7-8e42-4fa6-8949-95b0f8c6648a', 'ca50d94d-5b36-4e49-8f99-682f9416e609'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:40 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:10:40 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Acquiring lock "cinder-quobyte-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Lock "cinder-quobyte-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f831b9-d696-4fd3-b6c9-7587c1b57673]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:40 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd Apr 15 16:10:40 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:40 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.975s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:40 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:10:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c62b6664-49cb-4f20-8119-cf4ffc5fb35d tempest-GroupsV314Test-725400122 None] Delete group completed successfully. Apr 15 16:10:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cac2e6da-02c3-4ea9-a7ff-0708b133d365 tempest-VolumesActionsTest-1176014197 None] Acquiring lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724" by "attach_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cac2e6da-02c3-4ea9-a7ff-0708b133d365 tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724" acquired by "attach_volume" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-cac2e6da-02c3-4ea9-a7ff-0708b133d365 tempest-VolumesActionsTest-1176014197 None] Attaching volume c37bc79e-42a5-4c55-90f6-7a25df91d724 to instance 2e384188-061d-4aee-ad19-5045b2cf0d21 at mountpoint /dev/vdb on host None. Apr 15 16:10:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-cac2e6da-02c3-4ea9-a7ff-0708b133d365 tempest-VolumesActionsTest-1176014197 None] Attach volume completed successfully. Apr 15 16:10:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cac2e6da-02c3-4ea9-a7ff-0708b133d365 tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724" released by "attach_volume" :: held 0.202s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:41 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" returned: 0 in 1.123s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:41 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd Apr 15 16:10:41 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-44bcd425-b8be-4358-b275-99c32c3584ef tempest-VolumesActionsTest-1176014197 None] Acquiring lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-detach_volume" by "detach_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:10:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-44bcd425-b8be-4358-b275-99c32c3584ef tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:10:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-44bcd425-b8be-4358-b275-99c32c3584ef tempest-VolumesActionsTest-1176014197 None] Detaching volume c37bc79e-42a5-4c55-90f6-7a25df91d724 from instance 2e384188-061d-4aee-ad19-5045b2cf0d21. Apr 15 16:10:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-44bcd425-b8be-4358-b275-99c32c3584ef tempest-VolumesActionsTest-1176014197 None] Detach volume completed successfully. Apr 15 16:10:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-44bcd425-b8be-4358-b275-99c32c3584ef tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:42 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" returned: 0 in 0.621s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Lock "cinder-quobyte-23c8f518-d9c5-4d05-bc38-12332ff0d1fd" released by "delete_volume" :: held 1.841s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Created reservations ['629d8705-ef80-4cf1-b9b5-099d9afb9487'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Created reservations ['0b89ab9b-1882-4ae7-823e-4070637d29ed', '13c91a9d-c486-4f5e-ba17-d811c9c50f1b', '1509e256-a306-4737-b1c2-6dd05d9be980', '84576a5e-ad04-4217-a1f7-22a065864698'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:42 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:10:42 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:43 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.622s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:43 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:10:43 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-aaa48556-52d5-48a2-a0f2-5b3217702e45 tempest-GroupsV314Test-725400122 None] Delete group completed successfully. Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (fe219803-0cc5-49c6-adbc-3a4a84c0741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cd231c-53b9-4729-85d6-0b6e4957e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cd231c-53b9-4729-85d6-0b6e4957e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-677232045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574a1e4c7c2c42d9a34b400d3dbfe75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:50Z,use_quota=True,user_id='bd9d6c56045c49b7990da323b31883a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb676ec-d4db-47e9-84b4-c480615f5e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb676ec-d4db-47e9-84b4-c480615f5e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7074a804-0b6b-4cb4-b293-c19c9281bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7074a804-0b6b-4cb4-b293-c19c9281bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b', 'volume_name': 'volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a0b55f-2299-40a5-a121-e9cc1f0d9c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a0b55f-2299-40a5-a121-e9cc1f0d9c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed718c47-3b68-4dfd-8cc2-cabd8362bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:49 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Volume c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b', 'volume_size': 1} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-677232045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574a1e4c7c2c42d9a34b400d3dbfe75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:50Z,use_quota=True,user_id='bd9d6c56045c49b7990da323b31883a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Creating volume c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:10:49 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:10:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:50 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b 1073741824 Apr 15 16:10:50 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:50 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b 1073741824" returned: 0 in 0.699s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:50 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b Apr 15 16:10:50 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:51 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" returned: 0 in 0.662s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed718c47-3b68-4dfd-8cc2-cabd8362bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476d4c4e-bd5f-4b95-856d-9b64393f26ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:51 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Volume volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b (c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b): created successfully Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476d4c4e-bd5f-4b95-856d-9b64393f26ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (fe219803-0cc5-49c6-adbc-3a4a84c0741c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:51 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e64f11bd-f6ae-437c-ab4f-f2c5d5ba038b tempest-VolumesSnapshotTestJSON-1630264910 None] Created volume successfully. Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8359aba8-1f65-4386-8473-dae7f2cd3b2b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:52 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:10:52 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:52 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.755s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:52 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[20136e39-7461-41fa-9e9b-b6ac9bd3c98e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:52 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:10:52 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Flow 'volume_create_manager' (a975dc5a-ad1a-40cf-a94e-9d8e88d8e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e044a90-9a7f-49f0-a214-53f8dbbc6129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e044a90-9a7f-49f0-a214-53f8dbbc6129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-556993484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e31357-eb5e-4df6-b085-5944263a2de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df0d7faf2dd4f55a806f05ce822c942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:53Z,use_quota=True,user_id='fc4bf96213c34dfbaf58afbb3fb78aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a9ef24e-2b78-473d-b134-fc2922850771),volume_type_id=9a9ef24e-2b78-473d-b134-fc2922850771)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8282e6aa-c8a5-42f2-9822-01dc007bff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8282e6aa-c8a5-42f2-9822-01dc007bff5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9cbaed-379b-46bb-82fb-4f051a1c0e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9cbaed-379b-46bb-82fb-4f051a1c0e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e31357-eb5e-4df6-b085-5944263a2de6', 'volume_name': 'volume-b3e31357-eb5e-4df6-b085-5944263a2de6', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7672036-574d-425b-910f-31e6bc7c53e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7672036-574d-425b-910f-31e6bc7c53e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61853508-2d92-4d32-917f-05b5720f3b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:10:53 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Volume b3e31357-eb5e-4df6-b085-5944263a2de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e31357-eb5e-4df6-b085-5944263a2de6', 'volume_size': 1} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:10:53 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.588s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.6a60a955-e938-40d3-a141-4af1643e5233h70ymvh6.img {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:53 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.6a60a955-e938-40d3-a141-4af1643e5233h70ymvh6.img Apr 15 16:10:53 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:55 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.6a60a955-e938-40d3-a141-4af1643e5233h70ymvh6.img" returned: 0 in 2.505s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:55 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b257b274-0459-4e95-9d70-f9a3ef0be01b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:10:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:10:55 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:10:55 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:10:56 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 15 16:10:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.742s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:10:56 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.6a60a955-e938-40d3-a141-4af1643e5233h70ymvh6.img {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:10:56 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Converted 1024.00 MB image at 408.46 MB/s Apr 15 16:10:56 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] 6a60a955-e938-40d3-a141-4af1643e5233 was raw, no need to convert to raw {{(pid=82392) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 16:11:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:11:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:04 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:04 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:04 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.558s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:06 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:UPDATE=51,cinder:SELECT=40,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:11:06 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=41,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=11 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:11:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.429s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Uploaded volume to glance image-id: 6a60a955-e938-40d3-a141-4af1643e5233. {{(pid=82392) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 16:11:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.027s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Creating offline snapshot ffdfdb51-4662-4245-a1ba-ecdd92dd4228 of volume c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:11:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1e3826-63a7-45b7-9ec0-9f0f8ac95371]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:08 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e37dc272-c8c7-402c-8a4a-c7d7dd2772c7 tempest-VolumesActionsTest-1176014197 None] Copy volume to image completed successfully. Apr 15 16:11:08 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b Apr 15 16:11:08 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:08 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" returned: 0 in 0.576s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:09 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 1G Apr 15 16:11:09 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:09 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 1G" returned: 0 in 0.549s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:09 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 Apr 15 16:11:09 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:10 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228" returned: 0 in 0.495s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:10 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 is being set with open permissions: ugo+rw Apr 15 16:11:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:10 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 Apr 15 16:11:10 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:10 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228" returned: 0 in 0.478s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:10 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.info Apr 15 16:11:10 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:10 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.info" returned: 0 in 0.429s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:10 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.info is being set with open permissions: ugo+rw Apr 15 16:11:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:10 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.info Apr 15 16:11:10 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:11 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.info" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.338s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-556993484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e31357-eb5e-4df6-b085-5944263a2de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df0d7faf2dd4f55a806f05ce822c942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:10:53Z,use_quota=True,user_id='fc4bf96213c34dfbaf58afbb3fb78aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a9ef24e-2b78-473d-b134-fc2922850771),volume_type_id=9a9ef24e-2b78-473d-b134-fc2922850771)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Creating volume b3e31357-eb5e-4df6-b085-5944263a2de6 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:11 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:11 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 1073741824 Apr 15 16:11:11 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:11 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a1be7cd0-a76d-44ae-8eeb-736f94f4f2fa tempest-VolumesSnapshotTestJSON-1630264910 None] Create snapshot completed successfully Apr 15 16:11:11 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 1073741824" returned: 0 in 0.548s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:12 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 Apr 15 16:11:12 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-ffdfdb51-4662-4245-a1ba-ecdd92dd4228-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-ffdfdb51-4662-4245-a1ba-ecdd92dd4228-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-ffdfdb51-4662-4245-a1ba-ecdd92dd4228" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-ffdfdb51-4662-4245-a1ba-ecdd92dd4228" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Deleting offline snapshot ffdfdb51-4662-4245-a1ba-ecdd92dd4228 of volume c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] snapshot_file for this snap is: volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e863c660-c6a6-44ce-9fe7-8a2ccd541bea]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:12 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 Apr 15 16:11:12 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:12 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6" returned: 0 in 0.447s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.162s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61853508-2d92-4d32-917f-05b5720f3b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e31357-eb5e-4df6-b085-5944263a2de6', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a80721-f616-409b-a0f4-5d04d457f9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a666346-2046-47be-ae67-5b2930c4c66d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:12 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Volume volume-b3e31357-eb5e-4df6-b085-5944263a2de6 (b3e31357-eb5e-4df6-b085-5944263a2de6): created successfully Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a80721-f616-409b-a0f4-5d04d457f9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Flow 'volume_create_manager' (a975dc5a-ad1a-40cf-a94e-9d8e88d8e584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:12 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c17446aa-2c51-4ccd-b90f-b6de9269f7dd tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Created volume successfully. Apr 15 16:11:12 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:11:12 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:12 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228" returned: 0 in 0.512s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9940f637-e9fd-4d19-89f3-fc660872e008]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:12 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b Apr 15 16:11:12 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:12 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.520s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[22401742-69f2-4169-8870-d6b38a627dce]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:13 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:11:13 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Flow 'volume_create_manager' (60f57b36-084a-475e-aace-37adf03204f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b9ae7a-0534-4861-95f6-c5259ee89d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b9ae7a-0534-4861-95f6-c5259ee89d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-117485749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80fe14a-7437-410a-96aa-aa9d721422e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a6bde51b2447a095153bbd3e13ed9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:13Z,use_quota=True,user_id='8bed8a7bb81a4c39b4cc94df74297a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2182280f-85ab-4059-b573-6b5dbc3584aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2182280f-85ab-4059-b573-6b5dbc3584aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90da0fce-4cd7-4b1c-ad65-3c34322535f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90da0fce-4cd7-4b1c-ad65-3c34322535f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80fe14a-7437-410a-96aa-aa9d721422e7', 'volume_name': 'volume-c80fe14a-7437-410a-96aa-aa9d721422e7', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27753385-f23d-4594-a40c-5692204411fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27753385-f23d-4594-a40c-5692204411fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2771047e-82f7-4daa-818f-c71ea3ec1bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:13 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Volume c80fe14a-7437-410a-96aa-aa9d721422e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80fe14a-7437-410a-96aa-aa9d721422e7', 'volume_size': 1} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:13 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" returned: 0 in 0.534s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:13 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 Apr 15 16:11:13 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:13 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.703s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:13 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img Apr 15 16:11:13 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:13 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:13 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:13 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228" returned: 0 in 0.530s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:13 devstack sudo[86846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228 Apr 15 16:11:13 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:14 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:14 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a82dd145-60e4-4587-9a0f-7c0e781d47f7 tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Retype volume completed successfully. Apr 15 16:11:14 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b.ffdfdb51-4662-4245-a1ba-ecdd92dd4228" returned: 0 in 0.699s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-ffdfdb51-4662-4245-a1ba-ecdd92dd4228" released by "_delete_snapshot" :: held 2.401s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" released by "delete_snapshot" :: held 2.418s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:14 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Created reservations ['9ab17cf6-dead-4b02-a3d6-73669ceca807', '301e1cb3-4ee9-437c-aa9c-3f7042e1abbb', '5afdcb13-3c72-49d0-b8b5-9945b3de29ba', 'ad22797b-f1a6-4358-aa6f-d8a753948510'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Delete snapshot completed successfully. Apr 15 16:11:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-390084cf-579c-4249-b104-b51d6c299487 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-ffdfdb51-4662-4245-a1ba-ecdd92dd4228-delete_snapshot" released by "delete_snapshot" :: held 2.766s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Acquiring lock "cinder-b3e31357-eb5e-4df6-b085-5944263a2de6-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "cinder-b3e31357-eb5e-4df6-b085-5944263a2de6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Acquiring lock "cinder-quobyte-b3e31357-eb5e-4df6-b085-5944263a2de6" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "cinder-quobyte-b3e31357-eb5e-4df6-b085-5944263a2de6" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:15 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2d1035-0f55-473b-8374-3f83fe859788]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:15 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 Apr 15 16:11:15 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:16 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img" returned: 0 in 2.936s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2208a806-eb97-415a-a3ef-c3ae83bf7f78]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (8f325fb6-f4b2-4ec5-ab4d-d7cc48fb1c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba182fb6-90ac-4bfe-8fa8-8d491d3433db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba182fb6-90ac-4bfe-8fa8-8d491d3433db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1181238822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449b14dc-6759-4b8e-8f0f-637b6e2a4a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574a1e4c7c2c42d9a34b400d3dbfe75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:17Z,use_quota=True,user_id='bd9d6c56045c49b7990da323b31883a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da38db09-7c7f-4904-a9b1-e269df05e086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da38db09-7c7f-4904-a9b1-e269df05e086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0212f4e8-89f0-4cdb-9197-11b7c923f00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0212f4e8-89f0-4cdb-9197-11b7c923f00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449b14dc-6759-4b8e-8f0f-637b6e2a4a8b', 'volume_name': 'volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:16 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:11:16 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5232b91-1b2d-4697-934b-b0950c473295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5232b91-1b2d-4697-934b-b0950c473295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589de275-bf97-48c6-b2dd-f89553375c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:16 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume 449b14dc-6759-4b8e-8f0f-637b6e2a4a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b', 'volume_size': 1} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:16 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6" returned: 0 in 1.468s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:16 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6 Apr 15 16:11:16 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:17 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b3e31357-eb5e-4df6-b085-5944263a2de6" returned: 0 in 0.454s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "cinder-quobyte-b3e31357-eb5e-4df6-b085-5944263a2de6" released by "delete_volume" :: held 1.968s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:17 devstack cinder-volume[82392]: WARNING cinder.quota [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:11:17 devstack cinder-volume[82392]: WARNING cinder.quota [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Created reservations ['462a84a8-2db9-4330-960a-ac0d0c45263a', '8179f6f8-5d19-4b91-a2a7-5df030173828', '491406f2-29aa-4238-abaf-02751cbb3941', '05a6e0f8-6c0f-4816-8443-4bd25731fa72'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:17 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.674s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724, size 1024.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:11:17 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Converted 1024.00 MB image at 348.51 MB/s Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] 62dac764-7c88-404e-9608-ca2971d6ea32 was raw, converting to qcow2 {{(pid=82392) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 16:11:17 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:17 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f7b6d-b0b0-4aad-a67e-cd0c88a21b58]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:17 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img Apr 15 16:11:17 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:17 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.555s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:17 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Deleted volume successfully. Apr 15 16:11:17 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img" returned: 0 in 0.632s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:18 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img Apr 15 16:11:18 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c859ee22-1294-493b-8c71-b253d2e0e92a tempest-VolumeRetypeWithoutMigrationTest-428248593 None] Lock "cinder-b3e31357-eb5e-4df6-b085-5944263a2de6-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:18 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img" returned: 1 in 0.494s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:11:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img /opt/stack/data/cinder/conversion/vol_upload_nrz5w8yc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:18 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img /opt/stack/data/cinder/conversion/vol_upload_nrz5w8yc Apr 15 16:11:18 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:18 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img /opt/stack/data/cinder/conversion/vol_upload_nrz5w8yc" returned: 0 in 0.474s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:18 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Image conversion details: src /opt/stack/data/cinder/conversion/c37bc79e-42a5-4c55-90f6-7a25df91d724.temp_image.62dac764-7c88-404e-9608-ca2971d6ea32nvijzclu.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nrz5w8yc {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:11:18 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 16:11:18 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[25530857-8564-43eb-9260-a322c77debce]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nrz5w8yc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:19 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nrz5w8yc Apr 15 16:11:19 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:19 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nrz5w8yc" returned: 0 in 0.585s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.217s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Uploaded volume to glance image-id: 62dac764-7c88-404e-9608-ca2971d6ea32. {{(pid=82392) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.345s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-117485749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80fe14a-7437-410a-96aa-aa9d721422e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a6bde51b2447a095153bbd3e13ed9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:13Z,use_quota=True,user_id='8bed8a7bb81a4c39b4cc94df74297a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Creating volume c80fe14a-7437-410a-96aa-aa9d721422e7 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:20 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-132d4ae1-2705-4f42-b7c3-f7a07e5e7aca tempest-VolumesActionsTest-1176014197 None] Copy volume to image completed successfully. Apr 15 16:11:20 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 1073741824 Apr 15 16:11:20 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:21 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 1073741824" returned: 0 in 0.598s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:21 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 Apr 15 16:11:21 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Flow 'volume_create_manager' (e06e0daa-da0e-4a2c-b652-8b551ab9dabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8761d0-701b-4108-a401-d72cf411df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8761d0-701b-4108-a401-d72cf411df4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1016270798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a63e4d-53bb-4048-82bc-b81683d6b529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1065b5eb01d44c499b148dfabec35716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:22Z,use_quota=True,user_id='0c6421c191544a69b1b8adf928596713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8039018-f2c3-4841-8aff-41c918820f3e),volume_type_id=c8039018-f2c3-4841-8aff-41c918820f3e)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4731c4d-fbe4-4707-a35f-1bca111e3f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4731c4d-fbe4-4707-a35f-1bca111e3f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca75d45-91a3-49d2-ba09-dca5323ab3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:21 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca75d45-91a3-49d2-ba09-dca5323ab3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a63e4d-53bb-4048-82bc-b81683d6b529', 'volume_name': 'volume-21a63e4d-53bb-4048-82bc-b81683d6b529', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a399f7-90c6-40b1-b409-0f437915ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a399f7-90c6-40b1-b409-0f437915ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25ca2f8-748b-4cd8-8bc2-6185a069956e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:21 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Volume 21a63e4d-53bb-4048-82bc-b81683d6b529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a63e4d-53bb-4048-82bc-b81683d6b529', 'volume_size': 1} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7" returned: 0 in 0.429s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1181238822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449b14dc-6759-4b8e-8f0f-637b6e2a4a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574a1e4c7c2c42d9a34b400d3dbfe75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:17Z,use_quota=True,user_id='bd9d6c56045c49b7990da323b31883a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Creating volume 449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:21 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2771047e-82f7-4daa-818f-c71ea3ec1bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80fe14a-7437-410a-96aa-aa9d721422e7', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:21 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b 1073741824 Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4469182a-132b-45b1-9469-df1afef7de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:21 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:21 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Volume volume-c80fe14a-7437-410a-96aa-aa9d721422e7 (c80fe14a-7437-410a-96aa-aa9d721422e7): created successfully Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4469182a-132b-45b1-9469-df1afef7de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Flow 'volume_create_manager' (60f57b36-084a-475e-aace-37adf03204f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:21 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-bd75596e-13ab-4e62-97b7-905d3a5acebc tempest-ServersNegativeTestJSON-1267375537 None] Created volume successfully. Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Acquiring lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Acquiring lock "cinder-quobyte-c37bc79e-42a5-4c55-90f6-7a25df91d724" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Lock "cinder-quobyte-c37bc79e-42a5-4c55-90f6-7a25df91d724" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfdd967-b032-4da0-9da3-d708a323e160]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:22 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b 1073741824" returned: 0 in 0.588s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:22 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:11:22 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:22 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b Apr 15 16:11:22 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:22 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.560s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:22 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" returned: 0 in 0.489s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:22 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724 Apr 15 16:11:22 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.126s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1016270798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a63e4d-53bb-4048-82bc-b81683d6b529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1065b5eb01d44c499b148dfabec35716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:22Z,use_quota=True,user_id='0c6421c191544a69b1b8adf928596713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8039018-f2c3-4841-8aff-41c918820f3e),volume_type_id=c8039018-f2c3-4841-8aff-41c918820f3e)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Creating volume 21a63e4d-53bb-4048-82bc-b81683d6b529 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:22 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589de275-bf97-48c6-b2dd-f89553375c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:22 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 1073741824 Apr 15 16:11:22 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c068e1-7753-4f73-b632-36aef6b4693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:22 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b (449b14dc-6759-4b8e-8f0f-637b6e2a4a8b): created successfully Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c068e1-7753-4f73-b632-36aef6b4693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (8f325fb6-f4b2-4ec5-ab4d-d7cc48fb1c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:22 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-41952c5c-5551-4195-9c36-21bdf0360b89 tempest-VolumesSnapshotTestJSON-1630264910 None] Created volume successfully. Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Flow 'volume_create_manager' (aed89b0a-bbe4-4809-85cd-5f9fdff63aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b621c6ce-4ac9-442b-8151-cd561e838c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b621c6ce-4ac9-442b-8151-cd561e838c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1926587236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e02ee29-50d0-48cc-a3d3-d65bc671b62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a6bde51b2447a095153bbd3e13ed9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:23Z,use_quota=True,user_id='8bed8a7bb81a4c39b4cc94df74297a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea4d20d-cbd7-4857-b38d-dc386f1702c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea4d20d-cbd7-4857-b38d-dc386f1702c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f864b021-8657-44e9-bd83-71f4f669b2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f864b021-8657-44e9-bd83-71f4f669b2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e02ee29-50d0-48cc-a3d3-d65bc671b62d', 'volume_name': 'volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0210cd36-651a-4784-9cc9-f507204b8f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0210cd36-651a-4784-9cc9-f507204b8f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7708cf3b-abde-4c1e-9622-e12b8f5ae8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:23 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Volume 0e02ee29-50d0-48cc-a3d3-d65bc671b62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d', 'volume_size': 1} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:23 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c37bc79e-42a5-4c55-90f6-7a25df91d724" returned: 0 in 0.516s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Lock "cinder-quobyte-c37bc79e-42a5-4c55-90f6-7a25df91d724" released by "delete_volume" :: held 1.099s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Created reservations ['2cfd6635-569d-4640-a65c-4abfb40d490c', 'fee123cd-24c0-4e8d-963d-bcaa33e68b7b', '892013b6-76ff-400f-a0e1-b443a754e411', '706da692-dc80-43fd-947f-1a2b7b2c80a8'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:23 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:23 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:23 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 1073741824" returned: 0 in 0.597s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:23 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 Apr 15 16:11:23 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:23 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.428s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:23 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Deleted volume successfully. Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4145c98-70ec-447c-aeb9-ee45d5def40b tempest-VolumesActionsTest-1176014197 None] Lock "cinder-c37bc79e-42a5-4c55-90f6-7a25df91d724-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:23 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1926587236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e02ee29-50d0-48cc-a3d3-d65bc671b62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a6bde51b2447a095153bbd3e13ed9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:23Z,use_quota=True,user_id='8bed8a7bb81a4c39b4cc94df74297a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Creating volume 0e02ee29-50d0-48cc-a3d3-d65bc671b62d {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:23 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25ca2f8-748b-4cd8-8bc2-6185a069956e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a63e4d-53bb-4048-82bc-b81683d6b529', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:23 devstack sudo[86933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d 1073741824 Apr 15 16:11:23 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48d643a-bb0b-4e65-ae7a-28ce40c25274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:23 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Volume volume-21a63e4d-53bb-4048-82bc-b81683d6b529 (21a63e4d-53bb-4048-82bc-b81683d6b529): created successfully Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48d643a-bb0b-4e65-ae7a-28ce40c25274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Flow 'volume_create_manager' (e06e0daa-da0e-4a2c-b652-8b551ab9dabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:24 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8513d8ba-e930-4704-8b90-00edb7feb40c tempest-VolumeTypesAccessTest-1247486839 None] Created volume successfully. Apr 15 16:11:24 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d 1073741824" returned: 0 in 0.514s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:24 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d Apr 15 16:11:24 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Acquiring lock "cinder-21a63e4d-53bb-4048-82bc-b81683d6b529-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Lock "cinder-21a63e4d-53bb-4048-82bc-b81683d6b529-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Acquiring lock "cinder-quobyte-21a63e4d-53bb-4048-82bc-b81683d6b529" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Lock "cinder-quobyte-21a63e4d-53bb-4048-82bc-b81683d6b529" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:24 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d" returned: 0 in 0.493s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.642s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[af91918d-03ac-43a3-b890-d69124c256f3]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7708cf3b-abde-4c1e-9622-e12b8f5ae8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69da5696-f54e-4f7c-a673-f85cc4af8b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Creating offline snapshot e2d80e50-bc59-4ee0-8fbc-278389b331e7 of volume 449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:11:25 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Volume volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d (0e02ee29-50d0-48cc-a3d3-d65bc671b62d): created successfully Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69da5696-f54e-4f7c-a673-f85cc4af8b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Flow 'volume_create_manager' (aed89b0a-bbe4-4809-85cd-5f9fdff63aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba46f5f-d538-4b1d-a8ee-a367da144e7d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:25 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-40e60564-abc9-4466-8bbe-3822552889ea tempest-ServersNegativeTestJSON-1267375537 None] Created volume successfully. Apr 15 16:11:25 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 Apr 15 16:11:25 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:25 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b Apr 15 16:11:25 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:25 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" returned: 0 in 0.565s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:25 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529" returned: 0 in 0.628s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:25 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 1G Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "cinder-0e02ee29-50d0-48cc-a3d3-d65bc671b62d-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:25 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:25 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529 Apr 15 16:11:25 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Lock "cinder-0e02ee29-50d0-48cc-a3d3-d65bc671b62d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "cinder-quobyte-0e02ee29-50d0-48cc-a3d3-d65bc671b62d" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Lock "cinder-quobyte-0e02ee29-50d0-48cc-a3d3-d65bc671b62d" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473284e-9914-4de2-b2a5-254a38debf06]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:25 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d Apr 15 16:11:25 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:26 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-21a63e4d-53bb-4048-82bc-b81683d6b529" returned: 0 in 0.501s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Lock "cinder-quobyte-21a63e4d-53bb-4048-82bc-b81683d6b529" released by "delete_volume" :: held 1.172s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:26 devstack cinder-volume[82392]: WARNING cinder.quota [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1186933876 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1186933876, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:11:26 devstack cinder-volume[82392]: WARNING cinder.quota [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1186933876 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1186933876, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Created reservations ['b51ad0a4-ba7c-4726-ab75-a42608d90c6f', '26a53d9a-c8d5-4c8f-8556-79eda8f777e7', '31d8ef35-9dfb-4abb-a1a9-f95c22be6fff', '15ab8bb7-d1ef-4784-82c4-2ce9c88b112d'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:26 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 1G" returned: 0 in 0.588s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:26 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 Apr 15 16:11:26 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:26 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d" returned: 0 in 0.551s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:26 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:26 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:26 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d Apr 15 16:11:26 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:26 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7" returned: 0 in 0.636s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:26 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 is being set with open permissions: ugo+rw Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:26 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.589s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:26 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0e02ee29-50d0-48cc-a3d3-d65bc671b62d" returned: 0 in 0.583s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:26 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 Apr 15 16:11:26 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:26 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Deleted volume successfully. Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Lock "cinder-quobyte-0e02ee29-50d0-48cc-a3d3-d65bc671b62d" released by "delete_volume" :: held 1.170s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30c269fc-6210-4096-9ae1-91b671db7547 tempest-VolumeTypesAccessTest-1247486839 None] Lock "cinder-21a63e4d-53bb-4048-82bc-b81683d6b529-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Created reservations ['126bb772-045f-402a-be95-f36e110deaa5', '4bb0fc9c-b97f-4905-b830-f04a780b322f', 'ecd6e404-cceb-4af1-8533-27761a9089f9', '7a64d155-16aa-4409-8402-0fa0184c9d80'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:26 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:26 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:27 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7" returned: 0 in 0.577s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:27 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.info Apr 15 16:11:27 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:27 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.571s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:27 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Deleted volume successfully. Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48fc2ad5-16a1-4b7f-8f0c-3123e91851d9 tempest-ServersNegativeTestJSON-1267375537 None] Lock "cinder-0e02ee29-50d0-48cc-a3d3-d65bc671b62d-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "cinder-c80fe14a-7437-410a-96aa-aa9d721422e7-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Lock "cinder-c80fe14a-7437-410a-96aa-aa9d721422e7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "cinder-quobyte-c80fe14a-7437-410a-96aa-aa9d721422e7" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Lock "cinder-quobyte-c80fe14a-7437-410a-96aa-aa9d721422e7" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e852628b-8e66-425b-855a-d9922c8e14fa]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:27 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.info" returned: 0 in 0.552s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:27 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.info is being set with open permissions: ugo+rw Apr 15 16:11:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:28 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 Apr 15 16:11:28 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:28 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.info Apr 15 16:11:28 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:28 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7" returned: 0 in 0.646s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:28 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:28 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7 Apr 15 16:11:28 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.info" returned: 0 in 0.595s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.632s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:28 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8be6bf76-a518-4670-bfb3-daa5095fc17b tempest-VolumesSnapshotTestJSON-1630264910 None] Create snapshot completed successfully Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Flow 'volume_create_manager' (21a7f3bd-7f88-4157-94cb-05d52adceff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:29 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac7f05b-7506-48a4-9002-6c27e4b1af57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c80fe14a-7437-410a-96aa-aa9d721422e7" returned: 0 in 0.612s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Lock "cinder-quobyte-c80fe14a-7437-410a-96aa-aa9d721422e7" released by "delete_volume" :: held 1.306s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac7f05b-7506-48a4-9002-6c27e4b1af57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-364793783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6746ffe6-971f-45af-990e-416b6e7a0f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889bdc70e2b549cb8f88cc2750f3fbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:29Z,use_quota=True,user_id='5c15c61a50f542b0b3941c6e9c8447b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57aced8-0e48-46d0-896f-3fa27e40b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57aced8-0e48-46d0-896f-3fa27e40b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac017a9-25a1-4b4e-8263-95810e6e6523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac017a9-25a1-4b4e-8263-95810e6e6523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6746ffe6-971f-45af-990e-416b6e7a0f32', 'volume_name': 'volume-6746ffe6-971f-45af-990e-416b6e7a0f32', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731ef159-f21d-495b-9abc-00aabab7fdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731ef159-f21d-495b-9abc-00aabab7fdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbac86c-fa83-47b2-a427-c97ec1f5768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Volume 6746ffe6-971f-45af-990e-416b6e7a0f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6746ffe6-971f-45af-990e-416b6e7a0f32', 'volume_size': 1} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-364793783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6746ffe6-971f-45af-990e-416b6e7a0f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889bdc70e2b549cb8f88cc2750f3fbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:29Z,use_quota=True,user_id='5c15c61a50f542b0b3941c6e9c8447b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Creating volume 6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:29 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:29 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 1073741824 Apr 15 16:11:29 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Created reservations ['9c88fd28-d152-491e-ae37-a772ae7d8d5f', '4580650a-aeb9-4934-a38c-f24260f2fa5f', '76817584-baa7-4330-ad7c-0a4a453d78f2', '5e6554ab-4dd6-46c7-ad75-c0c5f17317d2'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:29 devstack sudo[87006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:29 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (636af859-e73f-4e3b-a023-5d9098165029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909e7b76-7cc9-4837-9f55-162f25450d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909e7b76-7cc9-4837-9f55-162f25450d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-849173120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3982f6da-7d04-42c3-b82b-c04c76590017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574a1e4c7c2c42d9a34b400d3dbfe75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e2d80e50-bc59-4ee0-8fbc-278389b331e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:30Z,use_quota=True,user_id='bd9d6c56045c49b7990da323b31883a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55061225-eb26-4346-aa46-9415d5a29af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55061225-eb26-4346-aa46-9415d5a29af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e138c89-f1eb-4ddd-a7e7-6618bf27fb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e138c89-f1eb-4ddd-a7e7-6618bf27fb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3982f6da-7d04-42c3-b82b-c04c76590017', 'volume_name': 'volume-3982f6da-7d04-42c3-b82b-c04c76590017', 'volume_size': 2, 'snapshot_id': 'e2d80e50-bc59-4ee0-8fbc-278389b331e7'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4ec14d-80d8-4a21-b063-b4730ddc354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4ec14d-80d8-4a21-b063-b4730ddc354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a7d586-1746-4aef-9d2a-5eb6de1691ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:29 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Volume 3982f6da-7d04-42c3-b82b-c04c76590017: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3982f6da-7d04-42c3-b82b-c04c76590017', 'volume_size': 2, 'snapshot_id': 'e2d80e50-bc59-4ee0-8fbc-278389b331e7'} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:30 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.530s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:30 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Deleted volume successfully. Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9e48d68a-9540-4542-8b07-e116c75f5365 tempest-ServersNegativeTestJSON-1267375537 None] Lock "cinder-c80fe14a-7437-410a-96aa-aa9d721422e7-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:30 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 1073741824" returned: 0 in 0.938s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:30 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 Apr 15 16:11:30 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:30 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32" returned: 0 in 0.499s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.684s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-e2d80e50-bc59-4ee0-8fbc-278389b331e7-3982f6da-7d04-42c3-b82b-c04c76590017" by "_create_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbac86c-fa83-47b2-a427-c97ec1f5768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6746ffe6-971f-45af-990e-416b6e7a0f32', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60620da-d88f-4748-9f59-e81066e5d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:30 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Volume volume-6746ffe6-971f-45af-990e-416b6e7a0f32 (6746ffe6-971f-45af-990e-416b6e7a0f32): created successfully Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60620da-d88f-4748-9f59-e81066e5d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Flow 'volume_create_manager' (21a7f3bd-7f88-4157-94cb-05d52adceff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-e2d80e50-bc59-4ee0-8fbc-278389b331e7-3982f6da-7d04-42c3-b82b-c04c76590017" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Creating volume 3982f6da-7d04-42c3-b82b-c04c76590017 from snapshot e2d80e50-bc59-4ee0-8fbc-278389b331e7 {{(pid=82392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-3982f6da-7d04-42c3-b82b-c04c76590017" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:30 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-468f2314-1456-4d54-9dd1-d8e047c0370c tempest-VolumesCloneTest-746950873 None] Created volume successfully. Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-3982f6da-7d04-42c3-b82b-c04c76590017" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] snapshot: e2d80e50-bc59-4ee0-8fbc-278389b331e7, volume: 3982f6da-7d04-42c3-b82b-c04c76590017, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f14749-a51c-450e-a8bd-450b1d18c686]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:30 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 Apr 15 16:11:30 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:31 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7" returned: 0 in 0.808s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:11:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:11:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:11:31 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4695d3bb-19e6-410d-a5cd-7dc7eb2bfc5f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:31 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b Apr 15 16:11:31 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Flow 'volume_create_manager' (d6efd879-c612-487a-8f04-10e564dc5f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b73c338-e3c4-4ed7-a138-029b3aff3c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b73c338-e3c4-4ed7-a138-029b3aff3c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-754152670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abeab909-9aad-4b1b-a1fa-94396c5238d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889bdc70e2b549cb8f88cc2750f3fbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6746ffe6-971f-45af-990e-416b6e7a0f32,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:32Z,use_quota=True,user_id='5c15c61a50f542b0b3941c6e9c8447b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabe68a8-5257-4a50-bd21-e97cdbdf11db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabe68a8-5257-4a50-bd21-e97cdbdf11db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfeece5-eb07-4594-af1e-66eb661adf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfeece5-eb07-4594-af1e-66eb661adf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'abeab909-9aad-4b1b-a1fa-94396c5238d7', 'volume_name': 'volume-abeab909-9aad-4b1b-a1fa-94396c5238d7', 'volume_size': 2, 'source_volid': '6746ffe6-971f-45af-990e-416b6e7a0f32', 'source_volstatus': 'available'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d9c84e-577c-4c0e-9904-435645b3ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d9c84e-577c-4c0e-9904-435645b3ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf3c132-7bf7-4418-a47c-d7f2a847ee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:32 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Volume abeab909-9aad-4b1b-a1fa-94396c5238d7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-abeab909-9aad-4b1b-a1fa-94396c5238d7', 'volume_size': 2, 'source_volid': '6746ffe6-971f-45af-990e-416b6e7a0f32', 'source_volstatus': 'available'} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:32 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" returned: 0 in 0.795s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:11:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:32 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 Apr 15 16:11:32 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:34 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017" returned: 0 in 2.333s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:34 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f93f49-f20a-4242-8d23-046a14b33b91]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:34 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b Apr 15 16:11:34 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:35 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" returned: 0 in 0.719s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:35 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:11:35 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Converted 1024.00 MB image at 438.65 MB/s Apr 15 16:11:35 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 is being set with open permissions: ugo+rw Apr 15 16:11:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:35 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 Apr 15 16:11:35 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:36 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017" returned: 0 in 0.546s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-3982f6da-7d04-42c3-b82b-c04c76590017" released by "_copy_volume_from_snapshot" :: held 5.283s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-e2d80e50-bc59-4ee0-8fbc-278389b331e7-3982f6da-7d04-42c3-b82b-c04c76590017" released by "_create_volume_from_snapshot" :: held 5.307s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.363s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.917s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:36 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Cloning volume 6746ffe6-971f-45af-990e-416b6e7a0f32 to volume abeab909-9aad-4b1b-a1fa-94396c5238d7 Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Creating offline snapshot 2684f977-f1e0-4df5-9b42-edca24ea0de0 of volume 6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a7d586-1746-4aef-9d2a-5eb6de1691ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3982f6da-7d04-42c3-b82b-c04c76590017', 'volume_size': 2, 'snapshot_id': 'e2d80e50-bc59-4ee0-8fbc-278389b331e7'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc10044-426b-4d78-aee7-6e7f3ef0fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a21cc04-c4db-441e-80e4-f82bc2ac440b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:36 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Volume volume-3982f6da-7d04-42c3-b82b-c04c76590017 (3982f6da-7d04-42c3-b82b-c04c76590017): created successfully Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc10044-426b-4d78-aee7-6e7f3ef0fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (636af859-e73f-4e3b-a023-5d9098165029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:36 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-32521a6b-c196-4e75-aa21-63fd36bce90d tempest-VolumesSnapshotTestJSON-1630264910 None] Created volume successfully. Apr 15 16:11:36 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 Apr 15 16:11:36 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-3982f6da-7d04-42c3-b82b-c04c76590017-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-3982f6da-7d04-42c3-b82b-c04c76590017-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-3982f6da-7d04-42c3-b82b-c04c76590017" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-3982f6da-7d04-42c3-b82b-c04c76590017" acquired by "delete_volume" :: waited 0.024s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3d1845-898a-431c-a573-b82e57905789]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:36 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 Apr 15 16:11:36 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:36 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32" returned: 0 in 0.812s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:36 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 1G Apr 15 16:11:36 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:37 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017" returned: 0 in 0.893s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:37 devstack sudo[87093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017 Apr 15 16:11:37 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:37 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 1G" returned: 0 in 0.696s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6746ffe6-971f-45af-990e-416b6e7a0f32 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:37 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6746ffe6-971f-45af-990e-416b6e7a0f32 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 Apr 15 16:11:37 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:38 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3982f6da-7d04-42c3-b82b-c04c76590017" returned: 0 in 0.587s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-3982f6da-7d04-42c3-b82b-c04c76590017" released by "delete_volume" :: held 1.505s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Created reservations ['ea39b974-26f5-48b4-93d4-84eb2c3064e3', '212cb156-b8fd-4ad0-9e81-6476acf1d179', 'dbbb4c2e-2aa8-4889-8681-0cb886783092', '11242ff0-f2c7-4863-899a-5baf36118086'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:38 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6746ffe6-971f-45af-990e-416b6e7a0f32 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0" returned: 0 in 0.641s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:38 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 is being set with open permissions: ugo+rw Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:38 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:38 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:38 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 Apr 15 16:11:38 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:38 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.476s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:38 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Deleted volume successfully. Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-98576a0d-58e2-4ec5-80b2-6635d52d0c83 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-3982f6da-7d04-42c3-b82b-c04c76590017-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:38 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0" returned: 0 in 0.577s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:38 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.info Apr 15 16:11:38 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-e2d80e50-bc59-4ee0-8fbc-278389b331e7-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-e2d80e50-bc59-4ee0-8fbc-278389b331e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-e2d80e50-bc59-4ee0-8fbc-278389b331e7" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-e2d80e50-bc59-4ee0-8fbc-278389b331e7" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Deleting offline snapshot e2d80e50-bc59-4ee0-8fbc-278389b331e7 of volume 449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] snapshot_file for this snap is: volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfdf149-0793-45f7-9e2f-ea264e4ff1ed]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:39 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 Apr 15 16:11:39 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Flow 'volume_create_manager' (b1306d6e-2142-476b-9fc5-57f623557ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12c8a2c-8cbf-4f27-afe7-a3afd6003c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12c8a2c-8cbf-4f27-afe7-a3afd6003c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1806797324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f949a6eede243fdba4103dfe2c1a438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:39Z,use_quota=True,user_id='d0eb5e0097b74d038b25a4713635c329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad92829-dfe6-46a1-a9f9-c585364458b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad92829-dfe6-46a1-a9f9-c585364458b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f9154a-b6c5-43fb-a623-7b205fef9420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f9154a-b6c5-43fb-a623-7b205fef9420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466', 'volume_name': 'volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c111542-d573-4b6d-87b7-a11287567718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c111542-d573-4b6d-87b7-a11287567718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a738ac8-d3ba-47eb-9925-2741af60d199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:39 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Volume 2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466', 'volume_size': 1} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:39 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.info" returned: 0 in 0.663s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:39 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.info is being set with open permissions: ugo+rw Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:39 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.info Apr 15 16:11:39 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:39 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7" returned: 0 in 0.637s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6377c61e-b0ac-4f4b-88d4-517b81dc18c1]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:39 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b Apr 15 16:11:39 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:40 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.info" returned: 0 in 0.471s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Acquiring lock "cinder-quobyte-abeab909-9aad-4b1b-a1fa-94396c5238d7" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Lock "cinder-quobyte-abeab909-9aad-4b1b-a1fa-94396c5238d7" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] snapshot: 2684f977-f1e0-4df5-9b42-edca24ea0de0, volume: abeab909-9aad-4b1b-a1fa-94396c5238d7, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbd0721-692d-4e1a-9783-b6839549c81e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:40 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 Apr 15 16:11:40 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:40 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" returned: 0 in 0.606s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:40 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 Apr 15 16:11:40 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:40 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0" returned: 0 in 0.568s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6746ffe6-971f-45af-990e-416b6e7a0f32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb6398-db0c-4751-b401-a6b01ef8934f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:40 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 Apr 15 16:11:40 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:40 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7" returned: 0 in 0.589s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:40 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7 Apr 15 16:11:40 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:41 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32" returned: 0 in 0.535s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:41 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:11:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:41 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 Apr 15 16:11:41 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:41 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b.e2d80e50-bc59-4ee0-8fbc-278389b331e7" returned: 0 in 0.499s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-e2d80e50-bc59-4ee0-8fbc-278389b331e7" released by "_delete_snapshot" :: held 2.400s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" released by "delete_snapshot" :: held 2.416s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:41 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Created reservations ['3c903d76-e1a4-4666-a1e0-dfeb7ad883e7', '44bbad94-0c0d-4538-834a-7a86eb5a8b6d', '47919b8b-89c0-42ae-ab58-46027d43c81a', '9ba5c0a9-cd34-441d-869e-c5333c831cc4'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Delete snapshot completed successfully. Apr 15 16:11:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2d160166-3eb5-4bf5-9bb4-3f65913a0e46 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-e2d80e50-bc59-4ee0-8fbc-278389b331e7-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" acquired by "delete_volume" :: waited 0.035s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:42 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a1397a-bc68-4890-848f-05bf92e52e51]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:42 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b Apr 15 16:11:42 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:43 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7" returned: 0 in 2.380s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:43 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f85a3-68e7-436e-978a-ea6f620b8070]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:43 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 Apr 15 16:11:43 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:43 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" returned: 0 in 0.999s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:43 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6720aa94-e9f0-4f7b-bfb1-575b2e3613e3 tempest-GroupSnapshotsTest-1095581999 None] Group tempest-GroupSnapshotsTest-Group-972420190: creating Apr 15 16:11:43 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b Apr 15 16:11:43 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:43 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6720aa94-e9f0-4f7b-bfb1-575b2e3613e3 tempest-GroupSnapshotsTest-1095581999 None] Group tempest-GroupSnapshotsTest-Group-972420190: created successfully Apr 15 16:11:43 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6720aa94-e9f0-4f7b-bfb1-575b2e3613e3 tempest-GroupSnapshotsTest-1095581999 None] Create group completed successfully. Apr 15 16:11:44 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" returned: 0 in 0.439s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b" released by "delete_volume" :: held 1.527s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Created reservations ['922790ee-64ac-45a1-a379-5f728b678639', '2c9e6a59-8e76-4811-85ad-ba306065d476', 'f5e5565a-fe1f-4a7f-b79d-289c254d68bc', 'ea78095a-6f73-4049-824e-faa0089bbd82'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:44 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32" returned: 0 in 0.640s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:11:44 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Converted 1024.00 MB image at 429.92 MB/s Apr 15 16:11:44 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 is being set with open permissions: ugo+rw Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:44 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 Apr 15 16:11:44 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:44 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:44 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:44 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7" returned: 0 in 0.417s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Lock "cinder-quobyte-abeab909-9aad-4b1b-a1fa-94396c5238d7" released by "_copy_volume_from_snapshot" :: held 4.590s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Acquiring lock "cinder-quobyte-2684f977-f1e0-4df5-9b42-edca24ea0de0" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Lock "cinder-quobyte-2684f977-f1e0-4df5-9b42-edca24ea0de0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:44 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Deleting offline snapshot 2684f977-f1e0-4df5-9b42-edca24ea0de0 of volume 6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] snapshot_file for this snap is: volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.432s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[605f2174-7a09-494d-9c41-6d67da4e9d14]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:44 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Deleted volume successfully. Apr 15 16:11:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29583a84-5d2a-475b-9820-d09cda496147 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-449b14dc-6759-4b8e-8f0f-637b6e2a4a8b-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:44 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 Apr 15 16:11:44 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Flow 'volume_create_manager' (8f7b892b-8ccc-43bf-b145-8312ecf3eb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f21fd2-3c42-4a5e-99f8-40d4e3e51910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f21fd2-3c42-4a5e-99f8-40d4e3e51910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92145285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb555205-2c11-4010-9525-29bb0ea9356a,host='devstack@QuobyteHD#QuobyteHD',id=085e52b1-b952-4c4c-934d-07d7d255d0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8884a082285648a7b50649957e8c47ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:45Z,use_quota=True,user_id='f0e20bfd5e6e4f0398e0cb0f7ca1656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93125b89-343a-4283-b9ec-7a8f89461ab2),volume_type_id=93125b89-343a-4283-b9ec-7a8f89461ab2)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a80daf-2c4d-4c62-a67e-1ee867b372a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a80daf-2c4d-4c62-a67e-1ee867b372a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcaef414-dd97-4802-8948-e64f17fbdd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcaef414-dd97-4802-8948-e64f17fbdd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085e52b1-b952-4c4c-934d-07d7d255d0e7', 'volume_name': 'volume-085e52b1-b952-4c4c-934d-07d7d255d0e7', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76eae1b2-8382-4cd5-8d73-c61fb21016b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76eae1b2-8382-4cd5-8d73-c61fb21016b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26aa217b-2fc8-4a53-96e3-f48f694ccc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Volume 085e52b1-b952-4c4c-934d-07d7d255d0e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085e52b1-b952-4c4c-934d-07d7d255d0e7', 'volume_size': 1} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (84f5948c-63bc-4082-8bf7-76f1c019f9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08bbf4-5cb0-4017-aeb9-c1ea01bf7122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08bbf4-5cb0-4017-aeb9-c1ea01bf7122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-878571546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2efbfed3-44a5-48c1-bd15-420bcb3cd7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574a1e4c7c2c42d9a34b400d3dbfe75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:45Z,use_quota=True,user_id='bd9d6c56045c49b7990da323b31883a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea3285d-7d74-477b-a979-48bef6504de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea3285d-7d74-477b-a979-48bef6504de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27076dc0-fde1-4167-811e-06ee4a8e550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27076dc0-fde1-4167-811e-06ee4a8e550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2efbfed3-44a5-48c1-bd15-420bcb3cd7a9', 'volume_name': 'volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9680b5e-e154-48d0-a034-aa1d0054ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9680b5e-e154-48d0-a034-aa1d0054ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359cfb22-c4de-4a38-8fe1-2d9208906a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:45 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume 2efbfed3-44a5-48c1-bd15-420bcb3cd7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9', 'volume_size': 1} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0" returned: 0 in 0.611s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6746ffe6-971f-45af-990e-416b6e7a0f32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ab79c1-a11f-41bc-ab1e-bf4c3633ff16]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:45 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 Apr 15 16:11:45 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:45 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32" returned: 0 in 0.470s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:45 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 Apr 15 16:11:45 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:46 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0" returned: 0 in 0.485s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:46 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0 Apr 15 16:11:46 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:46 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32.2684f977-f1e0-4df5-9b42-edca24ea0de0" returned: 0 in 0.411s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Lock "cinder-quobyte-2684f977-f1e0-4df5-9b42-edca24ea0de0" released by "_delete_snapshot" :: held 2.043s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.641s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.265s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1806797324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f949a6eede243fdba4103dfe2c1a438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:39Z,use_quota=True,user_id='d0eb5e0097b74d038b25a4713635c329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Creating volume 2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:46 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf3c132-7bf7-4418-a47c-d7f2a847ee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abeab909-9aad-4b1b-a1fa-94396c5238d7', 'volume_size': 2, 'source_volid': '6746ffe6-971f-45af-990e-416b6e7a0f32', 'source_volstatus': 'available'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672cde15-bcdc-4dbc-b5b6-436d87bc3579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:46 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 1073741824 Apr 15 16:11:46 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Volume volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 (abeab909-9aad-4b1b-a1fa-94396c5238d7): created successfully Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672cde15-bcdc-4dbc-b5b6-436d87bc3579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Flow 'volume_create_manager' (d6efd879-c612-487a-8f04-10e564dc5f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-65efa492-a419-485a-a4b0-0ea0e54ed815 tempest-VolumesCloneTest-746950873 None] Created volume successfully. Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Acquiring lock "cinder-abeab909-9aad-4b1b-a1fa-94396c5238d7-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Lock "cinder-abeab909-9aad-4b1b-a1fa-94396c5238d7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Acquiring lock "cinder-quobyte-abeab909-9aad-4b1b-a1fa-94396c5238d7" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Lock "cinder-quobyte-abeab909-9aad-4b1b-a1fa-94396c5238d7" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3805da-cd00-4faa-b3f4-6798510d149b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:47 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 Apr 15 16:11:47 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:47 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 1073741824" returned: 0 in 0.527s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:47 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 Apr 15 16:11:47 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:47 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7" returned: 0 in 0.530s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:47 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7 Apr 15 16:11:47 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:47 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466" returned: 0 in 0.416s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.643s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb555205-2c11-4010-9525-29bb0ea9356a,created_at=2026-04-15T14:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92145285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb555205-2c11-4010-9525-29bb0ea9356a,host='devstack@QuobyteHD#QuobyteHD',id=085e52b1-b952-4c4c-934d-07d7d255d0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8884a082285648a7b50649957e8c47ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:45Z,use_quota=True,user_id='f0e20bfd5e6e4f0398e0cb0f7ca1656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93125b89-343a-4283-b9ec-7a8f89461ab2),volume_type_id=93125b89-343a-4283-b9ec-7a8f89461ab2)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Creating volume 085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:47 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a738ac8-d3ba-47eb-9925-2741af60d199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1e740b-7eb2-47ef-9f46-29c45c03e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:47 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 1073741824 Apr 15 16:11:47 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Volume volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 (2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466): created successfully Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1e740b-7eb2-47ef-9f46-29c45c03e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Flow 'volume_create_manager' (b1306d6e-2142-476b-9fc5-57f623557ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:47 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-742fd375-b7eb-40b1-804c-f54d01c5cea3 tempest-VolumesTransfersTest-1354904384 None] Created volume successfully. Apr 15 16:11:48 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-abeab909-9aad-4b1b-a1fa-94396c5238d7" returned: 0 in 0.464s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Lock "cinder-quobyte-abeab909-9aad-4b1b-a1fa-94396c5238d7" released by "delete_volume" :: held 1.032s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Created reservations ['f87e5c41-b946-49bb-a3d3-ddb9e88f3233', '9e59cdea-0965-45e9-b606-1c1d1513562b', '8bc44f66-9d04-4553-ac46-a5f385a25974', '5c6f7271-55bc-43dc-a5bd-83ded2a2a80f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:48 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:48 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:48 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 1073741824" returned: 0 in 0.620s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:48 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 Apr 15 16:11:48 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1a919c4e-a03a-40c9-ac85-d420bad60473 tempest-VolumesTransfersTest-1173870803 None] Transfer volume completed successfully. Apr 15 16:11:48 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.446s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Deleted volume successfully. Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8a990be5-6dc8-4558-8e41-9d3f335ac285 tempest-VolumesCloneTest-746950873 None] Lock "cinder-abeab909-9aad-4b1b-a1fa-94396c5238d7-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:48 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7" returned: 0 in 0.410s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.471s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-878571546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2efbfed3-44a5-48c1-bd15-420bcb3cd7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574a1e4c7c2c42d9a34b400d3dbfe75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:45Z,use_quota=True,user_id='bd9d6c56045c49b7990da323b31883a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Creating volume 2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:48 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26aa217b-2fc8-4a53-96e3-f48f694ccc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085e52b1-b952-4c4c-934d-07d7d255d0e7', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e6bb4e-a628-4cfc-8b18-8ae3bc71cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:48 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 1073741824 Apr 15 16:11:48 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Volume volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 (085e52b1-b952-4c4c-934d-07d7d255d0e7): created successfully Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e6bb4e-a628-4cfc-8b18-8ae3bc71cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Flow 'volume_create_manager' (8f7b892b-8ccc-43bf-b145-8312ecf3eb97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b67249ae-b915-439c-8f4f-e93ff6ec8ee8 tempest-GroupSnapshotsTest-1095581999 None] Created volume successfully. Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Acquiring lock "cinder-6746ffe6-971f-45af-990e-416b6e7a0f32-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Lock "cinder-6746ffe6-971f-45af-990e-416b6e7a0f32-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Acquiring lock "cinder-quobyte-6746ffe6-971f-45af-990e-416b6e7a0f32" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Lock "cinder-quobyte-6746ffe6-971f-45af-990e-416b6e7a0f32" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e512f1-1424-481a-95bb-6b8034c2455c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:49 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 1073741824" returned: 0 in 0.543s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:49 devstack sudo[87268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 Apr 15 16:11:49 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:49 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 Apr 15 16:11:49 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Acquiring lock "cinder-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Lock "cinder-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Acquiring lock "cinder-quobyte-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Lock "cinder-quobyte-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1066b5a2-4557-457b-b5d4-4d52b4a144c2]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:49 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] GroupSnapshot 93ff9ad1-edc5-4c6a-ac89-d05d7fb28075: creating. Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Group snapshot 93ff9ad1-edc5-4c6a-ac89-d05d7fb28075: creating. {{(pid=82392) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:49 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 Apr 15 16:11:49 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:49 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32" returned: 0 in 0.525s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:49 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32 Apr 15 16:11:49 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:49 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" returned: 0 in 0.513s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.282s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359cfb22-c4de-4a38-8fe1-2d9208906a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf763fc-4e3e-4e67-ae3a-e52977fb568a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Creating offline snapshot cc918fec-380d-4c24-9aff-d3d2ffa5dc7c of volume 085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:11:49 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 (2efbfed3-44a5-48c1-bd15-420bcb3cd7a9): created successfully Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf763fc-4e3e-4e67-ae3a-e52977fb568a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (84f5948c-63bc-4082-8bf7-76f1c019f9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[55526898-5472-4959-b926-4253c2ced8eb]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:49 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1f2d7bcf-b373-4ce9-a044-174ad6ea48f4 tempest-VolumesSnapshotTestJSON-1630264910 None] Created volume successfully. Apr 15 16:11:49 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 Apr 15 16:11:49 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:50 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466" returned: 0 in 0.509s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:50 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466 Apr 15 16:11:50 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:50 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6746ffe6-971f-45af-990e-416b6e7a0f32" returned: 0 in 0.437s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Lock "cinder-quobyte-6746ffe6-971f-45af-990e-416b6e7a0f32" released by "delete_volume" :: held 0.996s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Created reservations ['9ceac5f4-6861-4b4f-a891-4022f871e308', '6442c23d-7408-4dd8-9822-c9063e781429', '88086cb0-f21b-4387-80b5-a0bd9bcbbb1c', '23f1033e-975b-4f15-871e-f6f7bf907e1a'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:50 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:50 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:50 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7" returned: 0 in 0.504s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:50 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c 1G Apr 15 16:11:50 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:50 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466" returned: 0 in 0.431s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Lock "cinder-quobyte-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466" released by "delete_volume" :: held 0.967s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Created reservations ['da866305-6e47-485a-ba54-d8dd3afa3064', 'fa142534-fcbe-4f84-a46a-75e733b375a1', 'c569e807-6222-4e2c-acdb-c3666061eff5', 'ae4f3d09-3027-4f18-ba03-3fb508922325'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:50 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:50 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:50 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.430s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:50 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Deleted volume successfully. Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9145ccaa-7ba8-4407-a59a-4dd34055dd07 tempest-VolumesCloneTest-746950873 None] Lock "cinder-6746ffe6-971f-45af-990e-416b6e7a0f32-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:50 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c 1G" returned: 0 in 0.532s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:50 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c Apr 15 16:11:50 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:51 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.509s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:51 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:51 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Deleted volume successfully. Apr 15 16:11:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-dddb1dca-5ab9-4d27-9b5e-e0c76166f24a tempest-VolumesTransfersTest-936788772 None] Lock "cinder-2f58edbf-bf1e-4334-b2fb-0f3d0c4b2466-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:51 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" returned: 0 in 0.442s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:51 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:11:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:51 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c Apr 15 16:11:51 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:51 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" returned: 0 in 0.433s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:51 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.info Apr 15 16:11:51 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Flow 'volume_create_manager' (f47a2424-5dc0-428e-b4f0-7b9068674218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc97333b-adc1-4469-87dc-80cfb40d9e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc97333b-adc1-4469-87dc-80cfb40d9e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-669786100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356c5f4b-be09-4fa9-b6d3-b36ee9366990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f949a6eede243fdba4103dfe2c1a438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:52Z,use_quota=True,user_id='d0eb5e0097b74d038b25a4713635c329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129abd12-7336-4373-a65b-9187cc555cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129abd12-7336-4373-a65b-9187cc555cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5a6817-8b4d-44eb-be1b-8d059f3e41b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5a6817-8b4d-44eb-be1b-8d059f3e41b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356c5f4b-be09-4fa9-b6d3-b36ee9366990', 'volume_name': 'volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98728c50-b6ae-40d5-af06-6a6010746ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98728c50-b6ae-40d5-af06-6a6010746ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6052212-ed66-4ce6-899c-fcb4dec4b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:52 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Volume 356c5f4b-be09-4fa9-b6d3-b36ee9366990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990', 'volume_size': 1} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:52 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.info" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:52 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:52 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.info Apr 15 16:11:52 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:52 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.info" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.922s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.089s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Creating offline snapshot 1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd of volume 2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[805ed259-21ca-45ce-96db-75cdac022cfa]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:52 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-14acd89f-b6c4-486e-b329-13be7191c93e tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 93ff9ad1-edc5-4c6a-ac89-d05d7fb28075: created successfully Apr 15 16:11:52 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 Apr 15 16:11:52 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Flow 'volume_create_manager' (65631fa8-a868-4071-ad59-4713b940fb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5271b3a6-2bbe-4a15-963f-acde8df310b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5271b3a6-2bbe-4a15-963f-acde8df310b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-15863450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37a743b-a3a9-4ae7-a94e-b341524ccc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2632407f6a4ad2b20525cd8c1e7214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:53Z,use_quota=True,user_id='08dc76316650484cb33686f720d5c798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e26e3ee-b1cd-4799-95a7-71feace5d367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e26e3ee-b1cd-4799-95a7-71feace5d367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6692aae1-1d64-47e5-8b1d-49aad55767c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6692aae1-1d64-47e5-8b1d-49aad55767c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37a743b-a3a9-4ae7-a94e-b341524ccc27', 'volume_name': 'volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27', 'volume_size': 2}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108dbc4b-ab8e-4251-8df2-859c94cc64f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108dbc4b-ab8e-4251-8df2-859c94cc64f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aeaf05-4244-4357-9c3f-6ee98a4fa33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:53 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Volume a37a743b-a3a9-4ae7-a94e-b341524ccc27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27', 'volume_size': 2} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:53 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" returned: 0 in 0.500s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:53 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd 1G Apr 15 16:11:53 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:53 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd 1G" returned: 0 in 0.470s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:53 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd Apr 15 16:11:53 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:54 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:54 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd is being set with open permissions: ugo+rw Apr 15 16:11:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:54 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd Apr 15 16:11:54 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:54 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" returned: 0 in 0.425s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:54 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.info Apr 15 16:11:54 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:55 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.info" returned: 0 in 0.395s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:55 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.info is being set with open permissions: ugo+rw Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:55 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.info Apr 15 16:11:55 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:55 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.info" returned: 0 in 0.409s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.693s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-669786100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356c5f4b-be09-4fa9-b6d3-b36ee9366990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f949a6eede243fdba4103dfe2c1a438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:52Z,use_quota=True,user_id='d0eb5e0097b74d038b25a4713635c329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Creating volume 356c5f4b-be09-4fa9-b6d3-b36ee9366990 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:55 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:55 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 1073741824 Apr 15 16:11:55 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:55 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ef0505d4-e539-4ca9-a328-ee790e7f7f14 tempest-VolumesSnapshotTestJSON-1630264910 None] Create snapshot completed successfully Apr 15 16:11:55 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 1073741824" returned: 0 in 0.476s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:56 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 Apr 15 16:11:56 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (2e4ac436-2896-4c07-b877-ab08a3b90b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a40800d-415d-4b13-a2fe-cda22da8242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a40800d-415d-4b13-a2fe-cda22da8242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1590466242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af05623-4f8a-4fbe-bbfb-a964b11e9083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574a1e4c7c2c42d9a34b400d3dbfe75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:56Z,use_quota=True,user_id='bd9d6c56045c49b7990da323b31883a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307766b6-620d-42c7-b018-008c3e2b1b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307766b6-620d-42c7-b018-008c3e2b1b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac068e4-9b5c-4043-ac06-7d7b232b66b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac068e4-9b5c-4043-ac06-7d7b232b66b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7af05623-4f8a-4fbe-bbfb-a964b11e9083', 'volume_name': 'volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083', 'volume_size': 1, 'snapshot_id': '1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15dde93f-266d-42aa-9348-6b42b746e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15dde93f-266d-42aa-9348-6b42b746e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8ffed9-a635-4375-b739-ac47347bfbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:56 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume 7af05623-4f8a-4fbe-bbfb-a964b11e9083: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083', 'volume_size': 1, 'snapshot_id': '1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd'} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:56 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.159s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-15863450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37a743b-a3a9-4ae7-a94e-b341524ccc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2632407f6a4ad2b20525cd8c1e7214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:11:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:11:53Z,use_quota=True,user_id='08dc76316650484cb33686f720d5c798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Creating volume a37a743b-a3a9-4ae7-a94e-b341524ccc27 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:56 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 2147483648 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6052212-ed66-4ce6-899c-fcb4dec4b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:56 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 2147483648 Apr 15 16:11:56 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b8cc35-30c5-47f0-92f6-3a9c66d9b66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:56 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Volume volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 (356c5f4b-be09-4fa9-b6d3-b36ee9366990): created successfully Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b8cc35-30c5-47f0-92f6-3a9c66d9b66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Flow 'volume_create_manager' (f47a2424-5dc0-428e-b4f0-7b9068674218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:56 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-176cfc11-2732-4b33-b4ba-5299a88d0252 tempest-VolumesTransfersTest-1354904384 None] Created volume successfully. Apr 15 16:11:56 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 2147483648" returned: 0 in 0.520s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:56 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 Apr 15 16:11:56 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:57 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27" returned: 0 in 0.403s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.774s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-cc918fec-380d-4c24-9aff-d3d2ffa5dc7c-a958f92d-5f22-4b67-8138-92412638cc49" by "_create_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aeaf05-4244-4357-9c3f-6ee98a4fa33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27', 'volume_size': 2}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67de93d-1d33-470f-b229-83b8ebfa5b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-cc918fec-380d-4c24-9aff-d3d2ffa5dc7c-a958f92d-5f22-4b67-8138-92412638cc49" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Creating volume a958f92d-5f22-4b67-8138-92412638cc49 from snapshot cc918fec-380d-4c24-9aff-d3d2ffa5dc7c {{(pid=82392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-a958f92d-5f22-4b67-8138-92412638cc49" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:57 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Volume volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 (a37a743b-a3a9-4ae7-a94e-b341524ccc27): created successfully Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67de93d-1d33-470f-b229-83b8ebfa5b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Flow 'volume_create_manager' (65631fa8-a868-4071-ad59-4713b940fb9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-a958f92d-5f22-4b67-8138-92412638cc49" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] snapshot: cc918fec-380d-4c24-9aff-d3d2ffa5dc7c, volume: a958f92d-5f22-4b67-8138-92412638cc49, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:11:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-73a3ab0b-7e2d-4f5a-9e72-97b1243bca3f tempest-VolumesCloneNegativeTest-1099107278 None] Created volume successfully. Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4090997b-02cf-4382-a805-452c9944b860]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:57 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c Apr 15 16:11:57 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Acquiring lock "cinder-356c5f4b-be09-4fa9-b6d3-b36ee9366990-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Lock "cinder-356c5f4b-be09-4fa9-b6d3-b36ee9366990-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Acquiring lock "cinder-quobyte-356c5f4b-be09-4fa9-b6d3-b36ee9366990" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Lock "cinder-quobyte-356c5f4b-be09-4fa9-b6d3-b36ee9366990" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52f7c75-b532-423f-9ae8-8eac1bae86b6]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:57 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 Apr 15 16:11:57 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:57 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" returned: 0 in 0.514s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-085e52b1-b952-4c4c-934d-07d7d255d0e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e263abf5-efd9-4a49-8443-482de13d5d5e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:58 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 Apr 15 16:11:58 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:58 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990" returned: 0 in 0.485s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:58 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990 Apr 15 16:11:58 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:58 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:58 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 Apr 15 16:11:58 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Acquiring lock "cinder-a37a743b-a3a9-4ae7-a94e-b341524ccc27-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:58 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Lock "cinder-a37a743b-a3a9-4ae7-a94e-b341524ccc27-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-356c5f4b-be09-4fa9-b6d3-b36ee9366990" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Acquiring lock "cinder-quobyte-a37a743b-a3a9-4ae7-a94e-b341524ccc27" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Lock "cinder-quobyte-356c5f4b-be09-4fa9-b6d3-b36ee9366990" released by "delete_volume" :: held 0.990s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Lock "cinder-quobyte-a37a743b-a3a9-4ae7-a94e-b341524ccc27" acquired by "delete_volume" :: waited 0.045s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Created reservations ['3c03ff35-2da2-46e8-98e9-79cfdd0feb20', 'b91b6ce0-f558-4f86-bf9d-b5ea26eda469', '37b872c7-9f13-4788-9b2d-7fac27a7f0d2', 'cde5ee91-ff34-4f12-b4b1-79f35080974c'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3840292-47b3-4fd1-95c3-b9916fee901f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:11:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:58 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:11:58 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:58 devstack sudo[87377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 Apr 15 16:11:58 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:59 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27" returned: 0 in 0.835s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:11:59 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27 Apr 15 16:11:59 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:11:59 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 15 16:11:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.156s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:11:59 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:11:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Deleted volume successfully. Apr 15 16:11:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4524930f-4f57-41a8-8390-e2e6a41aabbb tempest-VolumesTransfersTest-936788772 None] Lock "cinder-356c5f4b-be09-4fa9-b6d3-b36ee9366990-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:00 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a37a743b-a3a9-4ae7-a94e-b341524ccc27" returned: 0 in 0.857s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Lock "cinder-quobyte-a37a743b-a3a9-4ae7-a94e-b341524ccc27" released by "delete_volume" :: held 1.739s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Created reservations ['681c2604-e250-4378-8f29-2547e131e51f', '49a270da-537f-4855-b41e-dd75e7c7df23', 'b0b7e569-4942-43a8-bae2-e0a5625ac6db', 'f7bcc8e2-d078-45ab-9c73-3cbe9368a6fb'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:00 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:00 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:00 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49" returned: 0 in 2.319s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1546bfab-fc39-436b-b821-ab7afc7736dc]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:00 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 Apr 15 16:12:00 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:01 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.589s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:01 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Deleted volume successfully. Apr 15 16:12:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-649777cc-52ba-4a16-8c8b-23ddf8b63259 tempest-VolumesCloneNegativeTest-1099107278 None] Lock "cinder-a37a743b-a3a9-4ae7-a94e-b341524ccc27-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:01 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7" returned: 0 in 0.728s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:01 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:12:01 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Converted 1024.00 MB image at 441.30 MB/s Apr 15 16:12:01 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:12:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:01 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 Apr 15 16:12:01 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:02 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49" returned: 0 in 0.488s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-a958f92d-5f22-4b67-8138-92412638cc49" released by "_copy_volume_from_snapshot" :: held 4.595s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-cc918fec-380d-4c24-9aff-d3d2ffa5dc7c-a958f92d-5f22-4b67-8138-92412638cc49" released by "_create_volume_from_snapshot" :: held 4.631s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.654s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.786s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd-7af05623-4f8a-4fbe-bbfb-a964b11e9083" by "_create_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd-7af05623-4f8a-4fbe-bbfb-a964b11e9083" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Creating volume 7af05623-4f8a-4fbe-bbfb-a964b11e9083 from snapshot 1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd {{(pid=82392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-7af05623-4f8a-4fbe-bbfb-a964b11e9083" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-7af05623-4f8a-4fbe-bbfb-a964b11e9083" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] snapshot: 1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd, volume: 7af05623-4f8a-4fbe-bbfb-a964b11e9083, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7737f324-ae4d-4029-8114-d500c4ada37a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:02 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-fdce079d-0e5d-4fe0-8c73-32a1cf49db36 tempest-GroupSnapshotsTest-1095581999 None] Create group from source-snapshot-93ff9ad1-edc5-4c6a-ac89-d05d7fb28075 completed successfully. Apr 15 16:12:02 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd Apr 15 16:12:02 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-a958f92d-5f22-4b67-8138-92412638cc49" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-a958f92d-5f22-4b67-8138-92412638cc49" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[11932864-760f-4846-9047-d9b40d963732]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:02 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 Apr 15 16:12:02 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:02 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" returned: 0 in 0.685s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[625b3f6b-7636-4ebc-8d63-b59caa759757]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:02 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 Apr 15 16:12:02 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:03 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Flow 'volume_create_manager' (70ac11e8-c89f-4b0d-b69d-c1166facf6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eae4840-1c87-4539-b16e-4ca0cb3b06e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49" returned: 0 in 0.671s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:03 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49 Apr 15 16:12:03 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eae4840-1c87-4539-b16e-4ca0cb3b06e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-579716355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a073aa2c-3254-491f-a45a-4015dc53b9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b160a4a35a474851924b5ba571c981b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:03Z,use_quota=True,user_id='bb58c37e136b4b229f367140a2f536e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7c2e24-2892-4a86-b65e-6dee5f894f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7c2e24-2892-4a86-b65e-6dee5f894f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b44e22-bdb0-4e28-99f2-aa9b0dfbb03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.image.glance [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Creating Keystone auth plugin from conf {{(pid=82392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 16:12:03 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" returned: 0 in 0.698s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:03 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 Apr 15 16:12:03 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b44e22-bdb0-4e28-99f2-aa9b0dfbb03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a073aa2c-3254-491f-a45a-4015dc53b9a4', 'volume_name': 'volume-a073aa2c-3254-491f-a45a-4015dc53b9a4', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0534dea0-974d-4d69-b04e-aebe4d555b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0534dea0-974d-4d69-b04e-aebe4d555b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4edc65-edfe-4638-90e7-78d60a6f2f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:03 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Volume a073aa2c-3254-491f-a45a-4015dc53b9a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a073aa2c-3254-491f-a45a-4015dc53b9a4', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Trying to clone a073aa2c-3254-491f-a45a-4015dc53b9a4 from image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]). {{(pid=82392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 16:12:03 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a958f92d-5f22-4b67-8138-92412638cc49" returned: 0 in 0.576s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-a958f92d-5f22-4b67-8138-92412638cc49" released by "delete_volume" :: held 1.306s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 16:12:03 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Image download 20.69 MB at 20.69 MB/s Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:03 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:03 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a16671b-b901-4b81-a07b-f5cee5474b43]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['c130b21e-1878-406c-b65a-abe54d749eac'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:04 devstack cinder-volume[82392]: WARNING cinder.quota [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2096684932 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2096684932, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:04 devstack cinder-volume[82392]: WARNING cinder.quota [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2096684932 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2096684932, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['01cd736d-c987-4b96-8967-177ececfd9df', '3757755b-d6eb-424d-abce-9b32b084f476', 'c6839322-3fd0-4f95-b0dd-6887c8437181', '11dba68d-69e7-436f-b81e-7731250da1db'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:04 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD Apr 15 16:12:04 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:04 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:04 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:05 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 93ff9ad1-edc5-4c6a-ac89-d05d7fb28075: deleting Apr 15 16:12:05 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.081s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 93ff9ad1-edc5-4c6a-ac89-d05d7fb28075: deleting {{(pid=82392) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:05 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-9d7589bb-513d-4be7-a4ca-25170a0bb844 tempest-GroupSnapshotsTest-1095581999 None] Delete group completed successfully. Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-085e52b1-b952-4c4c-934d-07d7d255d0e7" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-085e52b1-b952-4c4c-934d-07d7d255d0e7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Deleting offline snapshot cc918fec-380d-4c24-9aff-d3d2ffa5dc7c of volume 085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] snapshot_file for this snap is: volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[174edc8c-6dcd-407f-a2bb-f491b7786ae1]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:05 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c Apr 15 16:12:05 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:05 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.818s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:05 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Flow 'volume_create_manager' (72aa822b-26ad-49f8-b115-774a000ecf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835c4e67-6e8f-4333-8dc4-154d426ea610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:06 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835c4e67-6e8f-4333-8dc4-154d426ea610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-159222709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981a19d1-f074-4b74-b9f0-1ddafbe786da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e2158835c594f25a077980673eafbca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:06Z,use_quota=True,user_id='ce6081bbfea74190aa52b08c867844c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bad01f-c9d4-4a79-b938-e4200fcc25f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bad01f-c9d4-4a79-b938-e4200fcc25f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01666d2-5ec1-4868-bb55-cf939f03d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:06 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01666d2-5ec1-4868-bb55-cf939f03d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981a19d1-f074-4b74-b9f0-1ddafbe786da', 'volume_name': 'volume-981a19d1-f074-4b74-b9f0-1ddafbe786da', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e8c6ff-6417-49c2-a5a5-5ae020707537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e8c6ff-6417-49c2-a5a5-5ae020707537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acc146a-e9e4-4657-b8b1-2a22b99cb50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:06 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Volume 981a19d1-f074-4b74-b9f0-1ddafbe786da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981a19d1-f074-4b74-b9f0-1ddafbe786da', 'volume_size': 1} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD" returned: 0 in 2.164s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Temporary image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 is fetched for user bb58c37e136b4b229f367140a2f536e0. {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083" returned: 0 in 2.649s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a01ad50-22b7-4476-b1c3-12c79d468347]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8a64af-5ad3-4878-a2dd-f500841c4945]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:06 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" returned: 0 in 0.863s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-085e52b1-b952-4c4c-934d-07d7d255d0e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:06 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 Apr 15 16:12:06 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f637d-ebcc-4eb8-8971-2361a49673f7]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:06 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD Apr 15 16:12:06 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:06 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 Apr 15 16:12:06 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:06 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:06 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7" returned: 0 in 0.500s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:06 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c Apr 15 16:12:06 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:06 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" returned: 0 in 0.617s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9, size 1024.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:12:06 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Converted 1024.00 MB image at 386.38 MB/s Apr 15 16:12:06 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 is being set with open permissions: ugo+rw Apr 15 16:12:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:06 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 Apr 15 16:12:06 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:07 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" returned: 0 in 0.486s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:07 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c Apr 15 16:12:07 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:07 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083" returned: 0 in 0.488s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-7af05623-4f8a-4fbe-bbfb-a964b11e9083" released by "_copy_volume_from_snapshot" :: held 5.230s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd-7af05623-4f8a-4fbe-bbfb-a964b11e9083" released by "_create_volume_from_snapshot" :: held 5.254s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.270s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-159222709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981a19d1-f074-4b74-b9f0-1ddafbe786da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e2158835c594f25a077980673eafbca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:06Z,use_quota=True,user_id='ce6081bbfea74190aa52b08c867844c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Creating volume 981a19d1-f074-4b74-b9f0-1ddafbe786da {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:07 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:UPDATE=167,cinder:SELECT=161,cinder:INSERT=42,cinder:DELETE=14 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=147,cinder:UPDATE=180,cinder:DELETE=14,cinder:INSERT=38 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:12:07 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da 1073741824 Apr 15 16:12:07 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8ffed9-a635-4375-b739-ac47347bfbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083', 'volume_size': 1, 'snapshot_id': '1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d5faf5-888f-4223-ab98-8f78ddf5cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:07 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Volume volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 (7af05623-4f8a-4fbe-bbfb-a964b11e9083): created successfully Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d5faf5-888f-4223-ab98-8f78ddf5cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Flow 'volume_create_manager' (2e4ac436-2896-4c07-b877-ab08a3b90b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:07 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-88fb3618-47c2-4804-ab8a-97678b7a97a3 tempest-VolumesSnapshotTestJSON-1630264910 None] Created volume successfully. Apr 15 16:12:07 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7.cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" returned: 0 in 0.426s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-cc918fec-380d-4c24-9aff-d3d2ffa5dc7c" released by "_delete_snapshot" :: held 2.340s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-085e52b1-b952-4c4c-934d-07d7d255d0e7" released by "delete_snapshot" :: held 2.362s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:07 devstack cinder-volume[82392]: WARNING cinder.quota [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2096684932 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2096684932, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['9ee4de84-1bbb-4954-84b8-bf98374ad37a', '186220c0-09d8-4704-9b66-7901c50b4e03', '14b24a25-6aa6-493d-bf7c-40f30e9b6f86', '8237f4ff-4540-4f72-a6f4-b0722b691385'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:07 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5535f06d-fadd-4c7f-95d2-3b7ecf65b5c3 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 93ff9ad1-edc5-4c6a-ac89-d05d7fb28075: deleted successfully Apr 15 16:12:07 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da 1073741824" returned: 0 in 0.511s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:07 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da Apr 15 16:12:07 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:08 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da" returned: 0 in 0.425s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.592s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-579716355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a073aa2c-3254-491f-a45a-4015dc53b9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b160a4a35a474851924b5ba571c981b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:03Z,use_quota=True,user_id='bb58c37e136b4b229f367140a2f536e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Creating volume a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:08 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:08 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 1073741824 Apr 15 16:12:08 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acc146a-e9e4-4657-b8b1-2a22b99cb50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981a19d1-f074-4b74-b9f0-1ddafbe786da', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c1057f-1485-41ba-a8d8-79c45a2cc8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-7af05623-4f8a-4fbe-bbfb-a964b11e9083-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-085e52b1-b952-4c4c-934d-07d7d255d0e7" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:08 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Volume volume-981a19d1-f074-4b74-b9f0-1ddafbe786da (981a19d1-f074-4b74-b9f0-1ddafbe786da): created successfully Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c1057f-1485-41ba-a8d8-79c45a2cc8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Flow 'volume_create_manager' (72aa822b-26ad-49f8-b115-774a000ecf4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-085e52b1-b952-4c4c-934d-07d7d255d0e7" acquired by "delete_volume" :: waited 0.025s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-7af05623-4f8a-4fbe-bbfb-a964b11e9083-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:08 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-dd2705ee-a18d-48c7-b6c1-837809dc6e7f tempest-VolumesListTestJSON-292882307 None] Created volume successfully. Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b229531b-901c-4c85-962a-b273e27fcff1]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-7af05623-4f8a-4fbe-bbfb-a964b11e9083" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-7af05623-4f8a-4fbe-bbfb-a964b11e9083" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afb827c-401e-4173-855b-cf2572f23a00]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:08 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 Apr 15 16:12:08 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:08 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 Apr 15 16:12:08 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:08 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 1073741824" returned: 0 in 0.502s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:08 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:08 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7" returned: 0 in 0.503s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:08 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:08 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7 Apr 15 16:12:08 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:09 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083" returned: 0 in 0.559s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:09 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083 Apr 15 16:12:09 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:09 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 0 in 0.432s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Attempting download of 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}])) to volume a073aa2c-3254-491f-a45a-4015dc53b9a4. {{(pid=82392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cee9d93-b322-43b6-b403-7e5e3fef4d3c]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_oslrr62k {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:09 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_oslrr62k Apr 15 16:12:09 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:09 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-085e52b1-b952-4c4c-934d-07d7d255d0e7" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-085e52b1-b952-4c4c-934d-07d7d255d0e7" released by "delete_volume" :: held 1.018s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['329b77ea-3175-4b5d-94bf-0eb5a1bef89e'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:09 devstack cinder-volume[82392]: WARNING cinder.db.sqlalchemy.api [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2096684932'] Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['ca24ba2c-e32b-41ff-827c-5872b289ae8f', 'eff9939d-48a8-43d6-9b2a-1869728408f2', '56a2f2d1-91c7-446d-a8bb-e4d86eea4e4d', '87680460-afa5-4c6e-96f1-145d696f5331'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:09 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7af05623-4f8a-4fbe-bbfb-a964b11e9083" returned: 0 in 0.583s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:09 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:09 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-7af05623-4f8a-4fbe-bbfb-a964b11e9083" released by "delete_volume" :: held 1.169s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Flow 'volume_create_manager' (ad3a9b9a-53a9-4f14-83d3-569a4a19723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e91187f-37b3-4a1c-a552-70cd36a3125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e91187f-37b3-4a1c-a552-70cd36a3125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-440687550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c0c716-73d6-4acb-892b-601fb1b8619c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e2158835c594f25a077980673eafbca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:10Z,use_quota=True,user_id='ce6081bbfea74190aa52b08c867844c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12583ff7-1dbc-4399-853b-e656f289d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12583ff7-1dbc-4399-853b-e656f289d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0c4a68-f51f-466c-a7a4-49c17078848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0c4a68-f51f-466c-a7a4-49c17078848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c0c716-73d6-4acb-892b-601fb1b8619c', 'volume_name': 'volume-64c0c716-73d6-4acb-892b-601fb1b8619c', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaadb057-ff3e-4c3c-97ce-ca96abac64b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaadb057-ff3e-4c3c-97ce-ca96abac64b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e0f098-340f-4a23-8ce1-08a209e76bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:09 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Volume 64c0c716-73d6-4acb-892b-601fb1b8619c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c0c716-73d6-4acb-892b-601fb1b8619c', 'volume_size': 1} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-440687550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c0c716-73d6-4acb-892b-601fb1b8619c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e2158835c594f25a077980673eafbca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:10Z,use_quota=True,user_id='ce6081bbfea74190aa52b08c867844c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Creating volume 64c0c716-73d6-4acb-892b-601fb1b8619c {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:09 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Created reservations ['2700ea2e-54a5-4816-a3db-b54f9c1917cb', 'c754b8e2-5443-4c66-98e2-568481a01246', '36d5c301-d1ac-49ce-bb2a-059e02e7105a', 'd4a69190-f105-42bf-b4a9-5e83836bd4b9'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:09 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c 1073741824 Apr 15 16:12:09 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:09 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:09 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:09 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_oslrr62k" returned: 0 in 0.598s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_oslrr62k {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:09 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_oslrr62k Apr 15 16:12:09 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:10 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d48a0f07-21db-4a09-a411-1df8e2c17fa1 tempest-GroupSnapshotsTest-1095581999 None] Delete group completed successfully. Apr 15 16:12:10 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.460s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Deleted volume successfully. Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09cd3684-8bb2-4f74-be94-f94b6010e78a tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-7af05623-4f8a-4fbe-bbfb-a964b11e9083-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:10 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c 1073741824" returned: 0 in 0.593s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:10 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c Apr 15 16:12:10 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:10 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_oslrr62k" returned: 1 in 0.467s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_oslrr62k' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2a5c5b-1d64-48a9-a28d-98b9e609713b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:10 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD Apr 15 16:12:10 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Deleting offline snapshot 1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd of volume 2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] snapshot_file for this snap is: volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e9365-923b-4f98-8a94-abab250a7c6a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:10 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd Apr 15 16:12:10 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:10 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c" returned: 0 in 0.513s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-517bf637-2c61-455b-9ae8-8489df75a525 tempest-GroupSnapshotsTest-1095581999 None] Group tempest-GroupSnapshotsTest-Group-456518251: creating Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e0f098-340f-4a23-8ce1-08a209e76bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c0c716-73d6-4acb-892b-601fb1b8619c', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1702a75-4d54-4902-b2b2-93d34d2bf27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:10 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Volume volume-64c0c716-73d6-4acb-892b-601fb1b8619c (64c0c716-73d6-4acb-892b-601fb1b8619c): created successfully Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1702a75-4d54-4902-b2b2-93d34d2bf27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Flow 'volume_create_manager' (ad3a9b9a-53a9-4f14-83d3-569a4a19723e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b92679ba-7b2a-48d5-a291-792d0b46c928 tempest-VolumesListTestJSON-292882307 None] Created volume successfully. Apr 15 16:12:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-517bf637-2c61-455b-9ae8-8489df75a525 tempest-GroupSnapshotsTest-1095581999 None] Group tempest-GroupSnapshotsTest-Group-456518251: created successfully Apr 15 16:12:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-517bf637-2c61-455b-9ae8-8489df75a525 tempest-GroupSnapshotsTest-1095581999 None] Create group completed successfully. Apr 15 16:12:10 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD" returned: 0 in 0.588s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 was qcow2, converting to raw {{(pid=82392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 16:12:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:11 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:11 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:11 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" returned: 0 in 0.488s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b53419b-ca33-4252-8eaf-7558fef38b3a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:11 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 Apr 15 16:12:11 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:11 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" returned: 0 in 0.543s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:11 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd Apr 15 16:12:11 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:11 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 0 in 0.959s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_75t_m4hkdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:12:11 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 16:12:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:11 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 1G Apr 15 16:12:11 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Flow 'volume_create_manager' (7ecfd24f-4163-480c-9302-018c6b40f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c360ca1-4c9c-430e-a643-a1fc604779ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c360ca1-4c9c-430e-a643-a1fc604779ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1296359798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8086601-73ec-4725-b169-2f24ce994a9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e2158835c594f25a077980673eafbca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:12Z,use_quota=True,user_id='ce6081bbfea74190aa52b08c867844c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0aed69-ab2e-432f-b513-3523a7a8481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0aed69-ab2e-432f-b513-3523a7a8481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee1e31f-10df-4715-b3f3-0082a9e1e84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee1e31f-10df-4715-b3f3-0082a9e1e84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8086601-73ec-4725-b169-2f24ce994a9f', 'volume_name': 'volume-c8086601-73ec-4725-b169-2f24ce994a9f', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f46393e-32d9-4a7b-8380-41bb78e20ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f46393e-32d9-4a7b-8380-41bb78e20ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a2ea0b-59a9-46a5-b8d6-f6e429c0a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Volume c8086601-73ec-4725-b169-2f24ce994a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8086601-73ec-4725-b169-2f24ce994a9f', 'volume_size': 1} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1296359798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8086601-73ec-4725-b169-2f24ce994a9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e2158835c594f25a077980673eafbca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:12Z,use_quota=True,user_id='ce6081bbfea74190aa52b08c867844c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Creating volume c8086601-73ec-4725-b169-2f24ce994a9f {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:12 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:12 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f 1073741824 Apr 15 16:12:12 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Flow 'volume_create_manager' (69281e82-f4a7-4f39-9a81-aaf3c970e7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4ec066-8c57-4831-b00b-80d181946afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4ec066-8c57-4831-b00b-80d181946afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2135489627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=658f15e6-eba4-4767-922c-58218dc5080b,host='devstack@QuobyteHD#QuobyteHD',id=d4402a1f-dfef-4ace-b18e-0e7d9c11f31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8884a082285648a7b50649957e8c47ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:12Z,use_quota=True,user_id='f0e20bfd5e6e4f0398e0cb0f7ca1656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1db39afa-a82d-41d7-bdfd-c9396b824731),volume_type_id=1db39afa-a82d-41d7-bdfd-c9396b824731)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c6fbea-e79f-47c0-9681-a83255606a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c6fbea-e79f-47c0-9681-a83255606a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6657a79c-3819-4ec3-a547-e17692d88030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6657a79c-3819-4ec3-a547-e17692d88030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4402a1f-dfef-4ace-b18e-0e7d9c11f31c', 'volume_name': 'volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f1fcbf-04c0-4fd4-b4a3-12207a175bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f1fcbf-04c0-4fd4-b4a3-12207a175bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b75192-6c93-4308-ab11-4f60504c5219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:12 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Volume d4402a1f-dfef-4ace-b18e-0e7d9c11f31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c', 'volume_size': 1} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:12 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" returned: 0 in 0.607s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:12 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd Apr 15 16:12:12 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:12 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 1G" returned: 0 in 0.578s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[711e46f0-6273-4f81-bac1-ed4a4b35eec5]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:12 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:12 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:12 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f 1073741824" returned: 0 in 0.602s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:12 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f Apr 15 16:12:12 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:12 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9.1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" returned: 0 in 0.428s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd" released by "_delete_snapshot" :: held 2.124s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" released by "delete_snapshot" :: held 2.134s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Created reservations ['3969b688-b53b-44bb-8dc2-6436f4c38433', '9a4555a3-dfa7-4633-9bd8-e291ec6145c0', 'd7d31a3b-b870-4f00-8781-511a30103efe', '7da6028e-563d-45cc-afde-fda2a1dfc942'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:12 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Delete snapshot completed successfully. Apr 15 16:12:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aa5c088b-0236-4432-b663-3b364cbf5770 tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-1015ddf7-0d20-4aa6-a2c7-fb35bdc2a6dd-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:13 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 0 in 0.546s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:13 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f" returned: 0 in 0.417s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=658f15e6-eba4-4767-922c-58218dc5080b,created_at=2026-04-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2135489627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=658f15e6-eba4-4767-922c-58218dc5080b,host='devstack@QuobyteHD#QuobyteHD',id=d4402a1f-dfef-4ace-b18e-0e7d9c11f31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8884a082285648a7b50649957e8c47ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:12Z,use_quota=True,user_id='f0e20bfd5e6e4f0398e0cb0f7ca1656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1db39afa-a82d-41d7-bdfd-c9396b824731),volume_type_id=1db39afa-a82d-41d7-bdfd-c9396b824731)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Creating volume d4402a1f-dfef-4ace-b18e-0e7d9c11f31c {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:13 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a2ea0b-59a9-46a5-b8d6-f6e429c0a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8086601-73ec-4725-b169-2f24ce994a9f', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:13 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c 1073741824 Apr 15 16:12:13 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7145fbdd-3757-4391-98fb-f62594002e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:13 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Volume volume-c8086601-73ec-4725-b169-2f24ce994a9f (c8086601-73ec-4725-b169-2f24ce994a9f): created successfully Apr 15 16:12:13 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7145fbdd-3757-4391-98fb-f62594002e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:13 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Flow 'volume_create_manager' (7ecfd24f-4163-480c-9302-018c6b40f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:13 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-82780895-0300-47da-97ea-9ca226a55488 tempest-VolumesListTestJSON-292882307 None] Created volume successfully. Apr 15 16:12:13 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 1 in 0.502s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Downloaded image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}])) to volume a073aa2c-3254-491f-a45a-4015dc53b9a4 successfully. {{(pid=82392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Temporary image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 for user bb58c37e136b4b229f367140a2f536e0 is deleted. {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Marking volume a073aa2c-3254-491f-a45a-4015dc53b9a4 as bootable. {{(pid=82392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Copying metadata from image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 to a073aa2c-3254-491f-a45a-4015dc53b9a4. {{(pid=82392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Creating volume glance metadata for volume a073aa2c-3254-491f-a45a-4015dc53b9a4 backed by image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 16:12:13 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4edc65-edfe-4638-90e7-78d60a6f2f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a073aa2c-3254-491f-a45a-4015dc53b9a4', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2479cdd4-2037-4d98-9345-ef8cbea2ddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c 1073741824" returned: 0 in 0.529s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:13 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Volume volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 (a073aa2c-3254-491f-a45a-4015dc53b9a4): created successfully Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2479cdd4-2037-4d98-9345-ef8cbea2ddc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Flow 'volume_create_manager' (70ac11e8-c89f-4b0d-b69d-c1166facf6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:13 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-730b58a3-dec7-41cf-8f0c-2a745f5c05c6 tempest-VolumesExtendTest-941109292 None] Created volume successfully. Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:13 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c Apr 15 16:12:13 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" acquired by "delete_volume" :: waited 0.019s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da98aee-849c-4037-bdcc-a0de02f01bba]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:14 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 Apr 15 16:12:14 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:14 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" returned: 0 in 0.433s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b75192-6c93-4308-ab11-4f60504c5219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0a06d2-6e2d-4768-b3eb-ff7bbc7bb7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:14 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Volume volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c (d4402a1f-dfef-4ace-b18e-0e7d9c11f31c): created successfully Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0a06d2-6e2d-4768-b3eb-ff7bbc7bb7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Flow 'volume_create_manager' (69281e82-f4a7-4f39-9a81-aaf3c970e7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0c9ad32b-0814-4b33-aecb-296514eda700 tempest-GroupSnapshotsTest-1095581999 None] Created volume successfully. Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014fc17-7475-4734-80c1-bbed104cd3b9]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:14 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:14 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:14 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" returned: 0 in 0.539s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:14 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9 Apr 15 16:12:14 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Flow 'volume_create_manager' (49a67dac-ab32-4c9f-94aa-ff3eba0040ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5797b1-54dc-4978-8684-aff5099117a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5797b1-54dc-4978-8684-aff5099117a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-503509583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=658f15e6-eba4-4767-922c-58218dc5080b,host='devstack@QuobyteHD#QuobyteHD',id=6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8884a082285648a7b50649957e8c47ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:15Z,use_quota=True,user_id='f0e20bfd5e6e4f0398e0cb0f7ca1656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1db39afa-a82d-41d7-bdfd-c9396b824731),volume_type_id=1db39afa-a82d-41d7-bdfd-c9396b824731)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaeb3ab-9013-43aa-bca9-840c7efee995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaeb3ab-9013-43aa-bca9-840c7efee995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23eea4ca-0c0d-4d4b-ad7c-2a42fb03f55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23eea4ca-0c0d-4d4b-ad7c-2a42fb03f55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b', 'volume_name': 'volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0856bd6b-81a4-4a76-84d4-96d2e23fe492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0856bd6b-81a4-4a76-84d4-96d2e23fe492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1453d06f-066c-4000-a464-00c21db946d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:14 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Volume 6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b', 'volume_size': 1} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:14 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 0 in 0.577s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:15 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:15 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:15 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" returned: 0 in 0.593s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9" released by "delete_volume" :: held 1.183s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Created reservations ['60c43eb9-17a1-49fa-b57e-16d907598fd5', '3115748e-2790-4b53-b21d-50dd495f037e', 'c7e6fb3c-218c-4855-80ad-d65fd3db90b4', '5faa27c4-4af1-4b3d-b750-5862f8ed363f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:15 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:15 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:15 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 1 in 0.528s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 2G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 2G" returned: 0 in 0.042s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.184s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=658f15e6-eba4-4767-922c-58218dc5080b,created_at=2026-04-15T14:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-503509583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=658f15e6-eba4-4767-922c-58218dc5080b,host='devstack@QuobyteHD#QuobyteHD',id=6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8884a082285648a7b50649957e8c47ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:15Z,use_quota=True,user_id='f0e20bfd5e6e4f0398e0cb0f7ca1656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1db39afa-a82d-41d7-bdfd-c9396b824731),volume_type_id=1db39afa-a82d-41d7-bdfd-c9396b824731)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Creating volume 6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:15 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:15 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b 1073741824 Apr 15 16:12:15 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:15 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-4c3d345a-959c-4f55-9df2-667b9e171a6a tempest-VolumesExtendTest-941109292 None] Extend volume completed successfully. Apr 15 16:12:15 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.472s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:15 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Deleted volume successfully. Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aec4ec3a-8bdd-489b-adde-2026efad466b tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-2efbfed3-44a5-48c1-bd15-420bcb3cd7a9-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "cinder-c8086601-73ec-4725-b169-2f24ce994a9f-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-c8086601-73ec-4725-b169-2f24ce994a9f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "cinder-quobyte-c8086601-73ec-4725-b169-2f24ce994a9f" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-quobyte-c8086601-73ec-4725-b169-2f24ce994a9f" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaa53d9-dbf4-4356-a9ce-ed36a169f49c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:15 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f Apr 15 16:12:15 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:16 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b 1073741824" returned: 0 in 0.579s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:16 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b Apr 15 16:12:16 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "cinder-quobyte-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d32d80-fb31-4418-9d65-a5be5708713a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:16 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b Apr 15 16:12:16 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:16 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f" returned: 0 in 0.532s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:16 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f Apr 15 16:12:16 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Acquiring lock "cinder-a073aa2c-3254-491f-a45a-4015dc53b9a4-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Lock "cinder-a073aa2c-3254-491f-a45a-4015dc53b9a4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Acquiring lock "cinder-quobyte-a073aa2c-3254-491f-a45a-4015dc53b9a4" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:16 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:16 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" returned: 0 in 0.515s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" returned: 0 in 0.583s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Lock "cinder-quobyte-a073aa2c-3254-491f-a45a-4015dc53b9a4" acquired by "delete_volume" :: waited 0.028s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:16 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b Apr 15 16:12:16 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1453d06f-066c-4000-a464-00c21db946d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd59b25-81e1-4f7a-bcba-06f7958ef62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[93100595-3bcf-474f-9d84-91ffe3ee87d6]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:16 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Volume volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b (6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b): created successfully Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd59b25-81e1-4f7a-bcba-06f7958ef62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Flow 'volume_create_manager' (49a67dac-ab32-4c9f-94aa-ff3eba0040ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:16 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2b68f47d-5846-48ed-8ed7-80eac7153b10 tempest-GroupSnapshotsTest-1095581999 None] Created volume successfully. Apr 15 16:12:16 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:16 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:16 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c8086601-73ec-4725-b169-2f24ce994a9f" returned: 0 in 0.486s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-quobyte-c8086601-73ec-4725-b169-2f24ce994a9f" released by "delete_volume" :: held 1.058s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:16 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Created reservations ['7e7df369-5aaa-46b3-9b5a-c08af44324f5', 'a65cca8c-cac3-4fc6-9486-798d1e1f5594', 'cc7bd481-504a-4007-90e3-022b063687d4', '734afb08-ef1b-4e37-b417-2947f8ea8007'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:17 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:17 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:17 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2df7b4fe-1fe0-471a-b222-d02abf922af7 tempest-GroupSnapshotsTest-1095581999 None] Update group completed successfully. Apr 15 16:12:17 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" returned: 0 in 0.475s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-quobyte-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b" released by "delete_volume" :: held 1.021s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:17 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Created reservations ['436bb7e6-8f7a-4933-9bb5-4be4b6371889', 'a4f709a5-1a4a-4af5-93a4-fbe60b8606c2', 'a5a8dbc9-cddd-4f71-8f19-43fe25bc08f4', '315559f3-423a-49d2-a01a-111d95d87a26'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:17 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:17 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:17 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:17 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:17 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:17 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Deleted volume successfully. Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-33c30f5d-d5a0-4813-9d6c-e218b9512229 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-c8086601-73ec-4725-b169-2f24ce994a9f-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:17 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 1 in 0.464s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:17 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.427s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:17 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4 Apr 15 16:12:17 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:17 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Deleted volume successfully. Apr 15 16:12:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d5242ef-2ef7-4761-a0a5-a0387e6d26ba tempest-VolumesSnapshotTestJSON-1630264910 None] Lock "cinder-c1ec63f9-2c62-4c94-96f2-9deee0a7ab7b-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "cinder-64c0c716-73d6-4acb-892b-601fb1b8619c-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-64c0c716-73d6-4acb-892b-601fb1b8619c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "cinder-quobyte-64c0c716-73d6-4acb-892b-601fb1b8619c" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-quobyte-64c0c716-73d6-4acb-892b-601fb1b8619c" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c788768a-842c-48ac-a2b2-4c844982ddad]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:18 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a073aa2c-3254-491f-a45a-4015dc53b9a4" returned: 0 in 0.434s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Lock "cinder-quobyte-a073aa2c-3254-491f-a45a-4015dc53b9a4" released by "delete_volume" :: held 1.428s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:18 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c Apr 15 16:12:18 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Created reservations ['82720d02-8751-4bbe-bc19-74cbe0bdb23b', '0642d160-9e93-49ea-aa13-aab43d43ae39', '75e5db3e-b670-4670-a7c4-96c2d087880b', '3a7ed9ff-82b9-47df-9089-42ab7fb53465'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:18 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:18 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:18 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-51deafab-6a1c-4c20-83ab-a2e4323cad1c tempest-GroupSnapshotsTest-1095581999 None] Update group completed successfully. Apr 15 16:12:18 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:18 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c Apr 15 16:12:18 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:18 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.442s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:18 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Deleted volume successfully. Apr 15 16:12:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-488c825a-2a92-4800-a091-cb3d8f3f4e16 tempest-VolumesExtendTest-941109292 None] Lock "cinder-a073aa2c-3254-491f-a45a-4015dc53b9a4-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Flow 'volume_create_manager' (225bb14e-4d5b-42a2-a08a-9d03af4e612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d57093-df02-4f83-868c-b4f54a15588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d57093-df02-4f83-868c-b4f54a15588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-559182277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66411c0-30f0-45c7-9f9d-d6d44d6b1b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b160a4a35a474851924b5ba571c981b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:19Z,use_quota=True,user_id='bb58c37e136b4b229f367140a2f536e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb56f1cb-5108-43f5-a7d8-9b5ab0e67e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb56f1cb-5108-43f5-a7d8-9b5ab0e67e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bf152c-6f45-4711-8435-da0a0a387152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:19 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bf152c-6f45-4711-8435-da0a0a387152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b66411c0-30f0-45c7-9f9d-d6d44d6b1b79', 'volume_name': 'volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37869ac-460f-4186-b37b-d117c224c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37869ac-460f-4186-b37b-d117c224c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387511fa-66df-458e-84d7-45aa79790133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:19 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Volume b66411c0-30f0-45c7-9f9d-d6d44d6b1b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79', 'volume_size': 1} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-559182277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66411c0-30f0-45c7-9f9d-d6d44d6b1b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b160a4a35a474851924b5ba571c981b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:19Z,use_quota=True,user_id='bb58c37e136b4b229f367140a2f536e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Creating volume b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:19 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-64c0c716-73d6-4acb-892b-601fb1b8619c" returned: 0 in 0.584s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-quobyte-64c0c716-73d6-4acb-892b-601fb1b8619c" released by "delete_volume" :: held 1.090s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:19 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 1073741824 Apr 15 16:12:19 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Created reservations ['841e7829-e033-4205-9abb-6921fb7a04e4', 'afa0a302-5abb-41e8-9d9b-dcbfcded859a', '07f46f87-d981-4701-a74d-8674c1fa3eb0', '5191404b-9a9d-48e0-ab60-a7b410ef9152'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:19 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:19 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:19 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-402c5dca-3f83-400f-a137-4fb4ac12b7e2 tempest-GroupSnapshotsTest-1095581999 None] Update group completed successfully. Apr 15 16:12:19 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 1073741824" returned: 0 in 0.592s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:19 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.510s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:19 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Deleted volume successfully. Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:19 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d22b8af3-068f-4775-a137-5e21724b4c84 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-64c0c716-73d6-4acb-892b-601fb1b8619c-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:19 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 Apr 15 16:12:19 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "cinder-981a19d1-f074-4b74-b9f0-1ddafbe786da-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-981a19d1-f074-4b74-b9f0-1ddafbe786da-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:20 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" returned: 0 in 0.517s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387511fa-66df-458e-84d7-45aa79790133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db994c-7e7d-4871-9bd3-854385a36c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:20 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Volume volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 (b66411c0-30f0-45c7-9f9d-d6d44d6b1b79): created successfully Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db994c-7e7d-4871-9bd3-854385a36c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Flow 'volume_create_manager' (225bb14e-4d5b-42a2-a08a-9d03af4e612b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "cinder-quobyte-981a19d1-f074-4b74-b9f0-1ddafbe786da" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b561f60c-6062-49a8-8c6e-57e0dedea7b0 tempest-VolumesExtendTest-941109292 None] Created volume successfully. Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-quobyte-981a19d1-f074-4b74-b9f0-1ddafbe786da" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbb4db0-ce1d-450b-b1e2-06e55684df15]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:20 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da Apr 15 16:12:20 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e2240c47-fde5-43a8-80e8-d3aff3a141f2 tempest-GroupSnapshotsTest-1095581999 None] Update group completed successfully. Apr 15 16:12:20 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da" returned: 0 in 0.557s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:20 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da Apr 15 16:12:20 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Creating offline snapshot da463f54-93ac-411d-855e-ffeb8a958ad1 of volume b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed1a14b-e7d4-4b5f-98a3-d2e911edb05f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:21 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 Apr 15 16:12:21 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:21 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-981a19d1-f074-4b74-b9f0-1ddafbe786da" returned: 0 in 0.564s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-quobyte-981a19d1-f074-4b74-b9f0-1ddafbe786da" released by "delete_volume" :: held 1.155s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Created reservations ['889b2986-81ea-48a6-b982-c4bd25e8ae48', '9206b068-5ff4-499b-9240-cdc381e7128b', '1a217370-9aa3-493a-b625-5af8869a28a3', '4bd7021c-ac27-4391-8654-f44c2a2a7ba9'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:21 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:21 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:21 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] GroupSnapshot 5eccca10-3643-4e93-b019-4ad4aad6f34d: creating. Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Group snapshot 5eccca10-3643-4e93-b019-4ad4aad6f34d: creating. {{(pid=82392) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 16:12:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:22 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" returned: 0 in 0.625s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:22 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 1G Apr 15 16:12:22 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:22 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.530s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:22 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Deleted volume successfully. Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-18295fef-b142-43a4-ae54-aae278129235 tempest-VolumesListTestJSON-292882307 None] Lock "cinder-981a19d1-f074-4b74-b9f0-1ddafbe786da-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (473fe1f5-6a48-41b9-b0b9-686f1fa7a47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8848da07-68f8-47ba-aa94-954912bd48ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8848da07-68f8-47ba-aa94-954912bd48ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2092070966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79eb51ed-b531-495d-9517-b4f3823b1b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:22Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0e549c-192f-4f1b-bd67-01249cc12afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0e549c-192f-4f1b-bd67-01249cc12afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01ecdc4-f445-4d8f-a3e2-922697d2c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01ecdc4-f445-4d8f-a3e2-922697d2c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79eb51ed-b531-495d-9517-b4f3823b1b2d', 'volume_name': 'volume-79eb51ed-b531-495d-9517-b4f3823b1b2d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017e8a60-e5e1-4a18-9776-2ba1836734a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017e8a60-e5e1-4a18-9776-2ba1836734a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dd0169-4b03-4ca1-81f6-5e40c3352c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Volume 79eb51ed-b531-495d-9517-b4f3823b1b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79eb51ed-b531-495d-9517-b4f3823b1b2d', 'volume_size': 1} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (5557097d-0288-42d5-8246-60fe5557d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e80dbb-e08f-4f8f-bfe2-9d227b7f9e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e80dbb-e08f-4f8f-bfe2-9d227b7f9e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2010487075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26242d2-a176-4277-b250-38753de13564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:23Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da3dbe9-92a8-4d8a-9df1-5293d8d3333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da3dbe9-92a8-4d8a-9df1-5293d8d3333d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d28f16-b70b-4d38-9d09-b2f99f8a9dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d28f16-b70b-4d38-9d09-b2f99f8a9dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26242d2-a176-4277-b250-38753de13564', 'volume_name': 'volume-a26242d2-a176-4277-b250-38753de13564', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca03498-953c-4ede-9a8c-5febe08aa67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca03498-953c-4ede-9a8c-5febe08aa67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce82b1a5-faf5-4552-b246-f29aa6a59101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Volume a26242d2-a176-4277-b250-38753de13564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26242d2-a176-4277-b250-38753de13564', 'volume_size': 1} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:22 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 1G" returned: 0 in 0.634s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:22 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 Apr 15 16:12:22 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (ecd84fd9-50b6-4220-ac55-80522f99e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6231040-2383-4a61-a81e-2855251e3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6231040-2383-4a61-a81e-2855251e3670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-422866476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db766a07-3b03-4193-a007-29aec9399266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:23Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740d327c-ac25-4281-85cc-9c2384f93a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740d327c-ac25-4281-85cc-9c2384f93a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaaf2b6-7c87-4ecc-b67f-ae2cd896cab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaaf2b6-7c87-4ecc-b67f-ae2cd896cab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db766a07-3b03-4193-a007-29aec9399266', 'volume_name': 'volume-db766a07-3b03-4193-a007-29aec9399266', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706dda37-f39d-4950-a33c-f6823ab1b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706dda37-f39d-4950-a33c-f6823ab1b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b58f58-0d58-49c2-b20f-dd390f6131a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:22 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Volume db766a07-3b03-4193-a007-29aec9399266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db766a07-3b03-4193-a007-29aec9399266', 'volume_size': 1} Apr 15 16:12:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (005980cf-f24f-4ede-be12-16a707e0a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98159f7-a5bc-461c-9c7c-2f66afc77d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98159f7-a5bc-461c-9c7c-2f66afc77d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1650158742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d824cc64-b984-4fee-a75d-3dad3fc024cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:23Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e01681-9812-4147-9f12-0ecd669ae1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e01681-9812-4147-9f12-0ecd669ae1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36529f5b-160d-4b4b-94db-0016460d006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36529f5b-160d-4b4b-94db-0016460d006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd824cc64-b984-4fee-a75d-3dad3fc024cd', 'volume_name': 'volume-d824cc64-b984-4fee-a75d-3dad3fc024cd', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc59b1a4-e8a7-43ab-8885-373d942818ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc59b1a4-e8a7-43ab-8885-373d942818ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd318d2e-a1e9-42a6-bd49-05c975f2f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Volume d824cc64-b984-4fee-a75d-3dad3fc024cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d824cc64-b984-4fee-a75d-3dad3fc024cd', 'volume_size': 1} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:23 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1" returned: 0 in 0.564s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:23 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 is being set with open permissions: ugo+rw Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:23 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 Apr 15 16:12:23 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (78cf241d-91cf-428c-9e7f-5c18580b1d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44d25b5-9329-4813-84e8-582f389bcca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44d25b5-9329-4813-84e8-582f389bcca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2111144027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6d2703-3139-47f0-8038-95feae2ea2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:23Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b25ef75-a623-44bc-a241-16331ae5c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b25ef75-a623-44bc-a241-16331ae5c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ce42c1-4f0a-45c5-bc9b-bb75a16843ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ce42c1-4f0a-45c5-bc9b-bb75a16843ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6d2703-3139-47f0-8038-95feae2ea2f0', 'volume_name': 'volume-6d6d2703-3139-47f0-8038-95feae2ea2f0', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ef6246-e335-4a94-8bb1-1e6eaf6d9c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ef6246-e335-4a94-8bb1-1e6eaf6d9c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d86b94b-28a0-40c1-ae04-6d1c5888e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:23 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Volume 6d6d2703-3139-47f0-8038-95feae2ea2f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6d2703-3139-47f0-8038-95feae2ea2f0', 'volume_size': 1} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:23 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1" returned: 0 in 0.474s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:23 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.info Apr 15 16:12:23 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:24 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.info" returned: 0 in 0.510s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:24 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.info is being set with open permissions: ugo+rw Apr 15 16:12:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:24 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.info Apr 15 16:12:24 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:24 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.info" returned: 0 in 0.526s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.396s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.941s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Creating offline snapshot c0e2d2ac-221c-46fd-b686-10f67c034095 of volume d4402a1f-dfef-4ace-b18e-0e7d9c11f31c {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:12:24 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[abde24d7-744a-4049-ba55-9beaac37faee]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:24 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e1a2d482-4eba-4953-a142-909ef9def12f tempest-VolumesExtendTest-941109292 None] Create snapshot completed successfully Apr 15 16:12:24 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c Apr 15 16:12:24 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:25 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" returned: 0 in 0.522s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:25 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 1G Apr 15 16:12:25 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-146d6549-b7b5-4b48-a3fd-3ea2951cfe01 tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:25 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 1G" returned: 0 in 0.567s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:25 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 Apr 15 16:12:25 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:26 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095" returned: 0 in 0.498s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:26 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:12:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:26 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 Apr 15 16:12:26 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:26 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:26 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.info Apr 15 16:12:26 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:27 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.info" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:27 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:27 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.info Apr 15 16:12:27 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:27 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.info" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.070s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Creating offline snapshot cb7fcaea-62cd-434a-910b-3a24c593f1da of volume 6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b42b6c-1a4b-4e0c-a9e3-3eb280c8487b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:27 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b Apr 15 16:12:27 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:28 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" returned: 0 in 0.549s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:28 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da 1G Apr 15 16:12:28 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:28 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da 1G" returned: 0 in 0.520s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:28 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da Apr 15 16:12:28 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:29 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da" returned: 0 in 0.535s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:29 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:12:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:29 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da Apr 15 16:12:29 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:30 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da" returned: 0 in 0.525s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:30 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.info Apr 15 16:12:30 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:30 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.info" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:30 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:30 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.info Apr 15 16:12:30 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:30 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.info" returned: 0 in 0.471s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.120s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.314s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2010487075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26242d2-a176-4277-b250-38753de13564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:23Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Creating volume a26242d2-a176-4277-b250-38753de13564 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:30 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:31 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 1073741824 Apr 15 16:12:31 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:31 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c8df725f-6203-4f4f-a1b2-3b3cbf728e5d tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 5eccca10-3643-4e93-b019-4ad4aad6f34d: created successfully Apr 15 16:12:31 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 5eccca10-3643-4e93-b019-4ad4aad6f34d: deleting Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 5eccca10-3643-4e93-b019-4ad4aad6f34d: deleting {{(pid=82392) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-c0e2d2ac-221c-46fd-b686-10f67c034095" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-c0e2d2ac-221c-46fd-b686-10f67c034095" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Deleting offline snapshot c0e2d2ac-221c-46fd-b686-10f67c034095 of volume d4402a1f-dfef-4ace-b18e-0e7d9c11f31c {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] snapshot_file for this snap is: volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a6eb71-e297-4ec4-bcf1-2cf0d8fe6223]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:31 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 Apr 15 16:12:31 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:31 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 1073741824" returned: 0 in 0.566s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:31 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 Apr 15 16:12:31 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:31 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095" returned: 0 in 0.607s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e0bb8d-a4c8-4f67-a226-4e73a66ee1d4]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:32 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c Apr 15 16:12:32 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:32 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564" returned: 0 in 0.627s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.238s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-422866476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db766a07-3b03-4193-a007-29aec9399266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:23Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Creating volume db766a07-3b03-4193-a007-29aec9399266 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:32 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:32 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 1073741824 Apr 15 16:12:32 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce82b1a5-faf5-4552-b246-f29aa6a59101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26242d2-a176-4277-b250-38753de13564', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fe30bc-9d0b-4db6-be00-7c6b135216c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:32 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Volume volume-a26242d2-a176-4277-b250-38753de13564 (a26242d2-a176-4277-b250-38753de13564): created successfully Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fe30bc-9d0b-4db6-be00-7c6b135216c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (5557097d-0288-42d5-8246-60fe5557d99e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:32 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b16ff48e-bd97-4356-a6ea-9f988005ebae tempest-CreateVolumesFromImageTest-1365552697 None] Created volume successfully. Apr 15 16:12:32 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" returned: 0 in 0.552s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:32 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 Apr 15 16:12:32 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:32 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 1073741824" returned: 0 in 0.615s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:32 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 Apr 15 16:12:32 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:33 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095" returned: 0 in 0.614s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:33 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095 Apr 15 16:12:33 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:33 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266" returned: 0 in 0.506s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.223s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1650158742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d824cc64-b984-4fee-a75d-3dad3fc024cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:23Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Creating volume d824cc64-b984-4fee-a75d-3dad3fc024cd {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:33 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b58f58-0d58-49c2-b20f-dd390f6131a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db766a07-3b03-4193-a007-29aec9399266', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdf383e-5242-4388-99f6-a3f236f2f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:33 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd 1073741824 Apr 15 16:12:33 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:33 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Volume volume-db766a07-3b03-4193-a007-29aec9399266 (db766a07-3b03-4193-a007-29aec9399266): created successfully Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdf383e-5242-4388-99f6-a3f236f2f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (ecd84fd9-50b6-4220-ac55-80522f99e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:33 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-7b06d316-e25d-4bf7-9335-6cd5b4c8056f tempest-CreateVolumesFromImageTest-1365552697 None] Created volume successfully. Apr 15 16:12:33 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c.c0e2d2ac-221c-46fd-b686-10f67c034095" returned: 0 in 0.494s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-c0e2d2ac-221c-46fd-b686-10f67c034095" released by "_delete_snapshot" :: held 2.342s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" released by "delete_snapshot" :: held 2.355s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-cb7fcaea-62cd-434a-910b-3a24c593f1da" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-cb7fcaea-62cd-434a-910b-3a24c593f1da" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Deleting offline snapshot cb7fcaea-62cd-434a-910b-3a24c593f1da of volume 6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] snapshot_file for this snap is: volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[783822cc-0273-4475-bcc9-98d13c243abf]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:33 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da Apr 15 16:12:33 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:33 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd 1073741824" returned: 0 in 0.574s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:33 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd Apr 15 16:12:33 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:34 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da" returned: 0 in 0.510s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1152d2f5-2577-465d-8bc3-258db45aa365]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:34 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b Apr 15 16:12:34 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:34 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd" returned: 0 in 0.429s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.976s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2111144027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6d2703-3139-47f0-8038-95feae2ea2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:23Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Creating volume 6d6d2703-3139-47f0-8038-95feae2ea2f0 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:34 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd318d2e-a1e9-42a6-bd49-05c975f2f122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d824cc64-b984-4fee-a75d-3dad3fc024cd', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:34 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 1073741824 Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5a6dba-f7a6-4e09-b959-f78f4d86fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:34 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:34 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Volume volume-d824cc64-b984-4fee-a75d-3dad3fc024cd (d824cc64-b984-4fee-a75d-3dad3fc024cd): created successfully Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5a6dba-f7a6-4e09-b959-f78f4d86fde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (005980cf-f24f-4ede-be12-16a707e0a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:34 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-42b4671a-f60d-498a-91a6-0491a6d2fa97 tempest-CreateVolumesFromImageTest-1365552697 None] Created volume successfully. Apr 15 16:12:34 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:34 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da Apr 15 16:12:34 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:34 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 1073741824" returned: 0 in 0.578s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:35 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 Apr 15 16:12:35 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:35 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da" returned: 0 in 0.476s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:35 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da Apr 15 16:12:35 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:35 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0" returned: 0 in 0.521s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-146d6549-b7b5-4b48-a3fd-3ea2951cfe01 tempest-VolumesExtendTest-941109292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.941s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d86b94b-28a0-40c1-ae04-6d1c5888e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6d2703-3139-47f0-8038-95feae2ea2f0', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77081684-20e2-408c-b1ff-d628175ebe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[effcf92a-2dcf-41e6-93cb-e401324bce47]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-146d6549-b7b5-4b48-a3fd-3ea2951cfe01 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:35 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Volume volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 (6d6d2703-3139-47f0-8038-95feae2ea2f0): created successfully Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77081684-20e2-408c-b1ff-d628175ebe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (78cf241d-91cf-428c-9e7f-5c18580b1d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:35 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b682a84d-18fb-4bd3-b86e-42f79bf2a32c tempest-CreateVolumesFromImageTest-1365552697 None] Created volume successfully. Apr 15 16:12:35 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 Apr 15 16:12:35 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:35 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b.cb7fcaea-62cd-434a-910b-3a24c593f1da" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-cb7fcaea-62cd-434a-910b-3a24c593f1da" released by "_delete_snapshot" :: held 1.981s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" released by "delete_snapshot" :: held 1.989s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:35 devstack cinder-volume[82392]: WARNING cinder.quota [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-175177594 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-175177594, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:35 devstack cinder-volume[82392]: WARNING cinder.quota [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-175177594 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-175177594, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['ab1a81bf-82c4-469f-94ec-5983ce269222', '6ec2cca1-f9c6-4762-9a5b-f7a72ae173d1', '7bcfa45e-7700-4bb2-934d-392c15e57d42', '5ab4fd91-bbe0-46b0-b690-23ec5000ad6b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:35 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['7c567481-e930-4417-b941-6bb408c0249c', '3a9ebf8b-e16f-40ab-b542-e966953a74de', 'd7c93739-67b6-46f9-b9a3-5cf77039e942', '85a8baba-52fe-4a0b-a75c-fa4b9d4c8182'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:35 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5f853150-3507-44e4-9ed2-c409b11a2640 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 5eccca10-3643-4e93-b019-4ad4aad6f34d: deleted successfully Apr 15 16:12:36 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-146d6549-b7b5-4b48-a3fd-3ea2951cfe01 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" returned: 0 in 0.572s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-146d6549-b7b5-4b48-a3fd-3ea2951cfe01 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 2G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-146d6549-b7b5-4b48-a3fd-3ea2951cfe01 tempest-VolumesExtendTest-941109292 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 2G" returned: 0 in 0.082s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-146d6549-b7b5-4b48-a3fd-3ea2951cfe01 tempest-VolumesExtendTest-941109292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.737s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.744s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2092070966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79eb51ed-b531-495d-9517-b4f3823b1b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c6ae9c26e4e2689931829e4dc4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:22Z,use_quota=True,user_id='cc007edce35745d5a780ca9afc0e45bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Creating volume 79eb51ed-b531-495d-9517-b4f3823b1b2d {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:36 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:36 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d 1073741824 Apr 15 16:12:36 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:36 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-146d6549-b7b5-4b48-a3fd-3ea2951cfe01 tempest-VolumesExtendTest-941109292 None] Extend volume completed successfully. Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[296a4498-4daf-4d8b-9e30-00539ae9802b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:37 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b Apr 15 16:12:37 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:37 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d 1073741824" returned: 0 in 0.752s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:37 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d Apr 15 16:12:37 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Acquiring lock "cinder-da463f54-93ac-411d-855e-ffeb8a958ad1-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Lock "cinder-da463f54-93ac-411d-855e-ffeb8a958ad1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Acquiring lock "cinder-quobyte-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Lock "cinder-quobyte-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Acquiring lock "cinder-quobyte-da463f54-93ac-411d-855e-ffeb8a958ad1" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Lock "cinder-quobyte-da463f54-93ac-411d-855e-ffeb8a958ad1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Deleting offline snapshot da463f54-93ac-411d-855e-ffeb8a958ad1 of volume b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] snapshot_file for this snap is: volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c3b650-1f0d-43f3-8dce-aee763da28b1]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:37 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 Apr 15 16:12:37 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:37 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" returned: 0 in 0.742s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:37 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b Apr 15 16:12:37 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:37 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d" returned: 0 in 0.704s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dd0169-4b03-4ca1-81f6-5e40c3352c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79eb51ed-b531-495d-9517-b4f3823b1b2d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c86203-2118-4db7-8908-abb60ea1a078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:37 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Volume volume-79eb51ed-b531-495d-9517-b4f3823b1b2d (79eb51ed-b531-495d-9517-b4f3823b1b2d): created successfully Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c86203-2118-4db7-8908-abb60ea1a078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Flow 'volume_create_manager' (473fe1f5-6a48-41b9-b0b9-686f1fa7a47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:37 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-11e7bb42-8d91-42d6-bf55-585839fe5125 tempest-CreateVolumesFromImageTest-1365552697 None] Created volume successfully. Apr 15 16:12:38 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1" returned: 0 in 0.638s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c394c-1276-4338-b364-919c83ab663e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:38 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 Apr 15 16:12:38 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:38 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" returned: 0 in 0.626s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-6bcd7e58-eaa3-4ece-89a8-6e8ea863b59b" released by "delete_volume" :: held 1.402s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[02311141-02f0-4037-bb28-02642b934a0e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-6d6d2703-3139-47f0-8038-95feae2ea2f0-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-6d6d2703-3139-47f0-8038-95feae2ea2f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:38 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c Apr 15 16:12:38 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-quobyte-6d6d2703-3139-47f0-8038-95feae2ea2f0" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-6d6d2703-3139-47f0-8038-95feae2ea2f0" acquired by "delete_volume" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e8448e-7257-4415-a1dd-e169d12a3f7c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:38 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 Apr 15 16:12:38 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:38 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" returned: 0 in 0.674s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:38 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 Apr 15 16:12:38 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:38 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" returned: 0 in 0.600s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:39 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c Apr 15 16:12:39 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:39 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0" returned: 0 in 0.594s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:39 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0 Apr 15 16:12:39 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:39 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1" returned: 0 in 0.559s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:39 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1 Apr 15 16:12:39 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:39 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" returned: 0 in 0.690s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-d4402a1f-dfef-4ace-b18e-0e7d9c11f31c" released by "delete_volume" :: held 1.324s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:39 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6d6d2703-3139-47f0-8038-95feae2ea2f0" returned: 0 in 0.615s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-6d6d2703-3139-47f0-8038-95feae2ea2f0" released by "delete_volume" :: held 1.238s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['855e902a-e927-4859-a873-1a42c882c0d6'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Created reservations ['abf72f8c-e4d3-4150-b45a-6990eee590bc', 'daafaf8a-f728-4773-b983-6fabb18ac04c', '2dbf8011-effa-4bfc-9c06-124be7558f46', '17cbe29f-9356-4794-8672-929fe99e931b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:39 devstack cinder-volume[82392]: WARNING cinder.quota [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-175177594 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-175177594, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['46f545ac-1ac1-4568-ab3a-ba23c2fe7feb', '43eba961-14e5-4ce5-9f32-af5d1083036f', 'fec5988b-82bc-4877-9930-d0e0633ce801', 'd8f098cd-358a-457d-a1ec-f3d08592e5e4'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:39 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:39 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:39 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['ab1466a7-5ffc-42be-bacb-43f788287999', '638e3ccb-38e1-4a21-ba91-a72b173c45fa', 'd65834cd-f268-45dd-bc8e-708ee43962c5', '0537afcf-1882-4d5c-86e2-7941e6c3ed3b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:40 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:40 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:40 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79.da463f54-93ac-411d-855e-ffeb8a958ad1" returned: 0 in 0.735s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Lock "cinder-quobyte-da463f54-93ac-411d-855e-ffeb8a958ad1" released by "_delete_snapshot" :: held 2.687s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Lock "cinder-quobyte-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" released by "delete_snapshot" :: held 2.712s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Created reservations ['5988c3e3-1f79-4a76-888c-11db76dd4eaf', '71cd19ef-4290-41c2-b1f3-38235bde51a0', 'ac828d15-8ba6-4568-94ea-887883e73b93', '6a9f36bc-e8d3-46a8-baa3-37a034d0be7f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Flow 'volume_create_manager' (ecad94d5-d9cd-4802-9940-910fb2b7b512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f06bbbf-a650-4e28-84fe-e6e863f04766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f06bbbf-a650-4e28-84fe-e6e863f04766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-966537316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7224bcd-e901-42fe-9b80-254f17170999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9f87b2436742caa2769833eb4fe74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:40Z,use_quota=True,user_id='99dc0b2eb30c4cf0b74014dcf97a1aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdcff0f-1cec-4116-a36e-309015158af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdcff0f-1cec-4116-a36e-309015158af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9718bd96-4624-4f15-8944-ed801e148bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9718bd96-4624-4f15-8944-ed801e148bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7224bcd-e901-42fe-9b80-254f17170999', 'volume_name': 'volume-a7224bcd-e901-42fe-9b80-254f17170999', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f945291-f659-4238-9088-765395ba03c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f945291-f659-4238-9088-765395ba03c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a2ec05-308a-4119-8c35-8b91fbda9654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:40 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Volume a7224bcd-e901-42fe-9b80-254f17170999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7224bcd-e901-42fe-9b80-254f17170999', 'volume_size': 1} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-966537316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7224bcd-e901-42fe-9b80-254f17170999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9f87b2436742caa2769833eb4fe74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:40Z,use_quota=True,user_id='99dc0b2eb30c4cf0b74014dcf97a1aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Creating volume a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:40 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:40 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:40 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 1073741824 Apr 15 16:12:40 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.629s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Delete snapshot completed successfully. Apr 15 16:12:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Deleted volume successfully. Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0e5635bc-c558-4808-b988-3ff02604f708 tempest-VolumesExtendTest-941109292 None] Lock "cinder-da463f54-93ac-411d-855e-ffeb8a958ad1-delete_snapshot" released by "delete_snapshot" :: held 3.081s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0b80cfc-909f-4d05-87c3-3d78d538778f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-6d6d2703-3139-47f0-8038-95feae2ea2f0-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-d824cc64-b984-4fee-a75d-3dad3fc024cd-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-d824cc64-b984-4fee-a75d-3dad3fc024cd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:40 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-87ff5148-5904-4663-afd9-cb35a050f263 tempest-GroupSnapshotsTest-1095581999 None] Group tempest-GroupSnapshotsTest-Group-1119340257: creating Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.656s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-87ff5148-5904-4663-afd9-cb35a050f263 tempest-GroupSnapshotsTest-1095581999 None] Group tempest-GroupSnapshotsTest-Group-1119340257: created successfully Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Acquiring lock "cinder-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-295c3b11-7665-4444-bf16-008570c0089b tempest-GroupSnapshotsTest-1095581999 None] Delete group completed successfully. Apr 15 16:12:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-87ff5148-5904-4663-afd9-cb35a050f263 tempest-GroupSnapshotsTest-1095581999 None] Create group completed successfully. Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-quobyte-d824cc64-b984-4fee-a75d-3dad3fc024cd" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Lock "cinder-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-d824cc64-b984-4fee-a75d-3dad3fc024cd" acquired by "delete_volume" :: waited 0.018s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[480182eb-93dc-416c-b319-e0bcc74896ef]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Acquiring lock "cinder-quobyte-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Lock "cinder-quobyte-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6465bf88-b76e-439d-a0d6-9a28b892f7eb]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:40 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd Apr 15 16:12:40 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:40 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 Apr 15 16:12:40 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:41 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 1073741824" returned: 0 in 0.536s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:41 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 Apr 15 16:12:41 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:41 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd" returned: 0 in 0.506s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:41 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:41 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd Apr 15 16:12:41 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" returned: 0 in 0.491s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:41 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79 Apr 15 16:12:41 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:41 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999" returned: 0 in 0.425s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a2ec05-308a-4119-8c35-8b91fbda9654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7224bcd-e901-42fe-9b80-254f17170999', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bb95d9-6197-4306-8eb2-b30020212f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:41 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Volume volume-a7224bcd-e901-42fe-9b80-254f17170999 (a7224bcd-e901-42fe-9b80-254f17170999): created successfully Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bb95d9-6197-4306-8eb2-b30020212f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Flow 'volume_create_manager' (ecad94d5-d9cd-4802-9940-910fb2b7b512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8b3c66f0-fb4e-4bbb-8456-70a91ed9b9ed tempest-SnapshotDependencyTests-858121715 None] Created volume successfully. Apr 15 16:12:41 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d824cc64-b984-4fee-a75d-3dad3fc024cd" returned: 0 in 0.432s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-d824cc64-b984-4fee-a75d-3dad3fc024cd" released by "delete_volume" :: held 0.981s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:41 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Created reservations ['a37c5d7f-7c1a-4ee2-8cf0-76bd283d170f', '59e8998f-8122-4304-9f79-c5ebc92afe11', 'dac03ca8-971a-47d6-9c4e-3d2e943c2aed', '59f1ddf2-518b-4d67-a718-0cb708ff6503'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Lock "cinder-quobyte-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79" released by "delete_volume" :: held 1.006s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Created reservations ['323b6346-218e-412c-9338-122be9e8543d', 'c61f8cd7-ff10-4e58-a73d-48c034bcd614', '18e0feb1-bc96-450d-938a-d7a503cabf11', '89dfcd62-1af5-48a5-a898-0b4b1f452118'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:41 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:41 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:41 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:41 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Flow 'volume_create_manager' (99052525-80f6-42e2-b1f3-f95fff682ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ce1eda-c93d-4ff8-811e-d721a11fb9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ce1eda-c93d-4ff8-811e-d721a11fb9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-669712926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e3e9d0a-75d6-4d0a-86d3-735888922404,host='devstack@QuobyteHD#QuobyteHD',id=3319ce8c-0e75-40ae-a3b9-3bc0a4f01387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8884a082285648a7b50649957e8c47ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:42Z,use_quota=True,user_id='f0e20bfd5e6e4f0398e0cb0f7ca1656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efadfa44-313e-4428-bdb3-39120ef95a45),volume_type_id=efadfa44-313e-4428-bdb3-39120ef95a45)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d200d843-35db-4505-b251-006c63b1bad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d200d843-35db-4505-b251-006c63b1bad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f994ac-3b19-4ddf-b873-8029e6aa547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f994ac-3b19-4ddf-b873-8029e6aa547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3319ce8c-0e75-40ae-a3b9-3bc0a4f01387', 'volume_name': 'volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046eec88-66f1-45c1-8c3b-99a4d17a1f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046eec88-66f1-45c1-8c3b-99a4d17a1f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf4d097-064c-4e5c-a317-5361d540a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:42 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Volume 3319ce8c-0e75-40ae-a3b9-3bc0a4f01387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387', 'volume_size': 1} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e3e9d0a-75d6-4d0a-86d3-735888922404,created_at=2026-04-15T14:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-669712926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e3e9d0a-75d6-4d0a-86d3-735888922404,host='devstack@QuobyteHD#QuobyteHD',id=3319ce8c-0e75-40ae-a3b9-3bc0a4f01387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8884a082285648a7b50649957e8c47ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:42Z,use_quota=True,user_id='f0e20bfd5e6e4f0398e0cb0f7ca1656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efadfa44-313e-4428-bdb3-39120ef95a45),volume_type_id=efadfa44-313e-4428-bdb3-39120ef95a45)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Creating volume 3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:42 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:42 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 1073741824 Apr 15 16:12:42 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:42 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.461s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:42 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Deleted volume successfully. Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84c645a4-a688-41d9-a03a-b1f127dcf9b9 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-d824cc64-b984-4fee-a75d-3dad3fc024cd-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:42 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.447s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:42 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Deleted volume successfully. Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5082203c-919c-4bb9-b712-b304a9e64cfd tempest-VolumesExtendTest-941109292 None] Lock "cinder-b66411c0-30f0-45c7-9f9d-d6d44d6b1b79-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:42 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 1073741824" returned: 0 in 0.541s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:42 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 Apr 15 16:12:42 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-db766a07-3b03-4193-a007-29aec9399266-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-db766a07-3b03-4193-a007-29aec9399266-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-quobyte-db766a07-3b03-4193-a007-29aec9399266" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-db766a07-3b03-4193-a007-29aec9399266" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a62ceeb-77b1-49e2-a007-815f2fdf7c76]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:43 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 Apr 15 16:12:43 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:43 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" returned: 0 in 0.505s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.601s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf4d097-064c-4e5c-a317-5361d540a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa8a0ce-0411-40a0-b125-be3d6031d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:43 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Volume volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 (3319ce8c-0e75-40ae-a3b9-3bc0a4f01387): created successfully Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa8a0ce-0411-40a0-b125-be3d6031d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Flow 'volume_create_manager' (99052525-80f6-42e2-b1f3-f95fff682ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Creating offline snapshot 7b7e5e84-e6b7-47e5-a10c-53bed759c71b of volume a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:12:43 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-57f76905-419c-4324-96ca-9e53bd4dcdd5 tempest-GroupSnapshotsTest-1095581999 None] Created volume successfully. Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fcdc8d-05bd-463d-a9f8-3f1e9598509c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:43 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 Apr 15 16:12:43 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:43 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266" returned: 0 in 0.540s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:43 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266 Apr 15 16:12:43 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:43 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999" returned: 0 in 0.561s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:43 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b 1G Apr 15 16:12:43 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:43 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-db766a07-3b03-4193-a007-29aec9399266" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-db766a07-3b03-4193-a007-29aec9399266" released by "delete_volume" :: held 1.023s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:43 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Created reservations ['4e30aff2-6aa6-4246-ae3c-5e4fdeaf477b', '7fa6f90d-8dcc-4aa4-8cd6-dfcea02aab6c', '7562a659-99cb-4ca0-a015-e051ff616015', 'cbb08962-a1d1-48a5-bf3a-9f9c9795bf21'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:44 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:44 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:44 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] GroupSnapshot 6f68e5b3-3f0d-42d7-b90f-8823f86401bb: creating. Apr 15 16:12:44 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Group snapshot 6f68e5b3-3f0d-42d7-b90f-8823f86401bb: creating. {{(pid=82392) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b 1G" returned: 0 in 0.598s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7224bcd-e901-42fe-9b80-254f17170999 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:44 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7224bcd-e901-42fe-9b80-254f17170999 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b Apr 15 16:12:44 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:44 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:44 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Deleted volume successfully. Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab69c68a-8215-4fe8-b014-d68239868c4f tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-db766a07-3b03-4193-a007-29aec9399266-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:44 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7224bcd-e901-42fe-9b80-254f17170999 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b" returned: 0 in 0.491s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:44 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b is being set with open permissions: ugo+rw Apr 15 16:12:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:44 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b Apr 15 16:12:44 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-a26242d2-a176-4277-b250-38753de13564-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-a26242d2-a176-4277-b250-38753de13564-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-quobyte-a26242d2-a176-4277-b250-38753de13564" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-a26242d2-a176-4277-b250-38753de13564" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efc47c1-0925-4c23-8c81-0c616fd58972]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:45 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 Apr 15 16:12:45 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:45 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b" returned: 0 in 0.495s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:45 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.info Apr 15 16:12:45 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:45 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564" returned: 0 in 0.549s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:45 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564 Apr 15 16:12:45 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:45 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.info" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:45 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.info is being set with open permissions: ugo+rw Apr 15 16:12:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:45 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.info Apr 15 16:12:45 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:46 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a26242d2-a176-4277-b250-38753de13564" returned: 0 in 0.426s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-a26242d2-a176-4277-b250-38753de13564" released by "delete_volume" :: held 1.001s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Created reservations ['6408db17-b790-4614-a59c-41419d44718b', '06e58a95-633e-4c6a-aae4-26ca1ab8fb6d', '04ac26c1-636a-4fe4-8921-89804d646a75', '9faf260b-1331-4f0f-9b07-71c1d411b689'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:46 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:46 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:46 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.info" returned: 0 in 0.459s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.178s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.975s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-498956f6-5c92-4db3-978a-f3cda89f7e79 tempest-SnapshotDependencyTests-858121715 None] Create snapshot completed successfully Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Creating offline snapshot 102b8763-d5da-47ca-8d87-b13c8a50c8b4 of volume 3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23831de-4052-4158-82b5-879e30250011]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:46 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 Apr 15 16:12:46 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:46 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.401s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Deleted volume successfully. Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-da31e0b7-5c8b-46d9-b393-9eda53e860ae tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-a26242d2-a176-4277-b250-38753de13564-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:46 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" returned: 0 in 0.516s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:46 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 1G Apr 15 16:12:46 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Flow 'volume_create_manager' (4a30cafc-1b9c-4f39-9050-8e2d66dcb9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc8f5e7-7712-4f58-bed5-594ecfd44fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc8f5e7-7712-4f58-bed5-594ecfd44fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9efba507-761b-4637-a325-e19a37d3dc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9f87b2436742caa2769833eb4fe74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b7e5e84-e6b7-47e5-a10c-53bed759c71b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:47Z,use_quota=True,user_id='99dc0b2eb30c4cf0b74014dcf97a1aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581b222a-155f-43c5-a07b-1dce821b8274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581b222a-155f-43c5-a07b-1dce821b8274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e6b5eb-c3d6-4fbe-9f46-e22c07229b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e6b5eb-c3d6-4fbe-9f46-e22c07229b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9efba507-761b-4637-a325-e19a37d3dc78', 'volume_name': 'volume-9efba507-761b-4637-a325-e19a37d3dc78', 'volume_size': 1, 'snapshot_id': '7b7e5e84-e6b7-47e5-a10c-53bed759c71b'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a4641b-ac8f-4294-82c5-1a2c2b4ea21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a4641b-ac8f-4294-82c5-1a2c2b4ea21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ef3eae-b7fd-44ea-8d1d-5f2e4909e707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Volume 9efba507-761b-4637-a325-e19a37d3dc78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9efba507-761b-4637-a325-e19a37d3dc78', 'volume_size': 1, 'snapshot_id': '7b7e5e84-e6b7-47e5-a10c-53bed759c71b'} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-79eb51ed-b531-495d-9517-b4f3823b1b2d-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-79eb51ed-b531-495d-9517-b4f3823b1b2d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "cinder-quobyte-79eb51ed-b531-495d-9517-b4f3823b1b2d" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-79eb51ed-b531-495d-9517-b4f3823b1b2d" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c07da-4c38-4d25-9448-645db12e9413]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:47 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d Apr 15 16:12:47 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:47 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 1G" returned: 0 in 0.497s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:47 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 Apr 15 16:12:47 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:47 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d" returned: 0 in 0.497s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:47 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d Apr 15 16:12:47 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:47 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4" returned: 0 in 0.438s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:47 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:12:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:47 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 Apr 15 16:12:47 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:48 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-79eb51ed-b531-495d-9517-b4f3823b1b2d" returned: 0 in 0.428s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-quobyte-79eb51ed-b531-495d-9517-b4f3823b1b2d" released by "delete_volume" :: held 0.950s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Created reservations ['d98adb20-043c-44b1-8d57-fd6432022f7d', '841022ed-b25e-41b8-bc0d-15cd175f8578', 'd53a176a-1c2b-4353-87b5-203477f5d2c5', 'e46b2f5f-9b6a-4cbb-a5fe-7db198c6eb14'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:48 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4" returned: 0 in 0.430s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:48 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:48 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:48 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.info Apr 15 16:12:48 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:48 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.493s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:48 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Deleted volume successfully. Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.info" returned: 0 in 0.482s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:48 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b0bc576a-8899-4c04-adce-29ef310121e6 tempest-CreateVolumesFromImageTest-1365552697 None] Lock "cinder-79eb51ed-b531-495d-9517-b4f3823b1b2d-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:48 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.info Apr 15 16:12:48 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:49 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.info" returned: 0 in 0.428s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.094s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-quobyte-7b7e5e84-e6b7-47e5-a10c-53bed759c71b-9efba507-761b-4637-a325-e19a37d3dc78" by "_create_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-7b7e5e84-e6b7-47e5-a10c-53bed759c71b-9efba507-761b-4637-a325-e19a37d3dc78" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Creating volume 9efba507-761b-4637-a325-e19a37d3dc78 from snapshot 7b7e5e84-e6b7-47e5-a10c-53bed759c71b {{(pid=82392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-quobyte-9efba507-761b-4637-a325-e19a37d3dc78" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-9efba507-761b-4637-a325-e19a37d3dc78" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] snapshot: 7b7e5e84-e6b7-47e5-a10c-53bed759c71b, volume: 9efba507-761b-4637-a325-e19a37d3dc78, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e097b-be75-4f0a-9678-7c3162771280]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:49 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-68943af9-0782-4d85-9d48-4cc5dce7ad4b tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 6f68e5b3-3f0d-42d7-b90f-8823f86401bb: created successfully Apr 15 16:12:49 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b Apr 15 16:12:49 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:49 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 6f68e5b3-3f0d-42d7-b90f-8823f86401bb: deleting Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 6f68e5b3-3f0d-42d7-b90f-8823f86401bb: deleting {{(pid=82392) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-102b8763-d5da-47ca-8d87-b13c8a50c8b4" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-102b8763-d5da-47ca-8d87-b13c8a50c8b4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Deleting offline snapshot 102b8763-d5da-47ca-8d87-b13c8a50c8b4 of volume 3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] snapshot_file for this snap is: volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a662f37-d814-4a19-a628-dc5b2fc3001e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:49 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b" returned: 0 in 0.553s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7224bcd-e901-42fe-9b80-254f17170999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20861ed-d9ed-4831-bbc6-716e71c4407a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:49 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 Apr 15 16:12:49 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:49 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 Apr 15 16:12:49 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (b1cf0d26-6419-4505-89e8-2667b1c22d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dddb75f-5d10-4a69-abbb-18a2a003147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dddb75f-5d10-4a69-abbb-18a2a003147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459334293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb1703c-a129-4b3e-b00f-93c905746d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:50Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e711d0-9a87-4552-9e20-2ddb4a9fd2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e711d0-9a87-4552-9e20-2ddb4a9fd2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fba876a-e9d9-4b98-a886-e2df53f6270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fba876a-e9d9-4b98-a886-e2df53f6270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb1703c-a129-4b3e-b00f-93c905746d74', 'volume_name': 'volume-deb1703c-a129-4b3e-b00f-93c905746d74', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d201b5-3438-4a6a-94cf-630e6a55f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d201b5-3438-4a6a-94cf-630e6a55f70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c4fa26-542e-42ff-8c46-f88bbaeae28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:50 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume deb1703c-a129-4b3e-b00f-93c905746d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb1703c-a129-4b3e-b00f-93c905746d74', 'volume_size': 1} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:50 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999" returned: 0 in 0.476s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:50 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4" returned: 0 in 0.531s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:50 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 Apr 15 16:12:50 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0444c678-9860-478b-8420-5ff7ac8d13f6]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:50 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 Apr 15 16:12:50 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:50 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" returned: 0 in 0.497s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:50 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 Apr 15 16:12:50 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:52 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4" returned: 0 in 1.512s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:52 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4 Apr 15 16:12:52 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:52 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78" returned: 0 in 2.069s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d908d26d-8ef9-4d0f-b68c-775b86c74950]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:52 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 Apr 15 16:12:52 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:52 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387.102b8763-d5da-47ca-8d87-b13c8a50c8b4" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-102b8763-d5da-47ca-8d87-b13c8a50c8b4" released by "_delete_snapshot" :: held 2.998s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" released by "delete_snapshot" :: held 3.011s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:52 devstack cinder-volume[82392]: WARNING cinder.quota [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-864511120 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-864511120, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:52 devstack cinder-volume[82392]: WARNING cinder.quota [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-864511120 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-864511120, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:52 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['8e18711c-302a-4319-8813-7c413ab5c5ec', '5fc8e82d-e39b-450f-af1e-1e3c9cd232cb', 'cd04aa3d-aa6a-491e-a2c9-bfeb2e59b9c9', '53ba812d-a966-4396-a21b-c85ade61b80b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:52 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ae36dfe8-b30c-45d5-b6fe-9d64c69be6a5 tempest-GroupSnapshotsTest-1095581999 None] group_snapshot 6f68e5b3-3f0d-42d7-b90f-8823f86401bb: deleted successfully Apr 15 16:12:53 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999" returned: 0 in 0.613s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:12:53 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Converted 1024.00 MB image at 494.63 MB/s Apr 15 16:12:53 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 is being set with open permissions: ugo+rw Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:53 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 Apr 15 16:12:53 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "cinder-quobyte-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0643ca9a-ddce-4b9c-a94a-a7c26e9322a2]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:53 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 Apr 15 16:12:53 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:53 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78" returned: 0 in 0.438s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-9efba507-761b-4637-a325-e19a37d3dc78" released by "_copy_volume_from_snapshot" :: held 4.210s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-7b7e5e84-e6b7-47e5-a10c-53bed759c71b-9efba507-761b-4637-a325-e19a37d3dc78" released by "_create_volume_from_snapshot" :: held 4.233s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.251s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.349s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459334293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb1703c-a129-4b3e-b00f-93c905746d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:50Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Creating volume deb1703c-a129-4b3e-b00f-93c905746d74 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:53 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:53 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 1073741824 Apr 15 16:12:53 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ef3eae-b7fd-44ea-8d1d-5f2e4909e707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9efba507-761b-4637-a325-e19a37d3dc78', 'volume_size': 1, 'snapshot_id': '7b7e5e84-e6b7-47e5-a10c-53bed759c71b'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b60e25-5300-4497-a277-84fc6be22894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:53 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Volume volume-9efba507-761b-4637-a325-e19a37d3dc78 (9efba507-761b-4637-a325-e19a37d3dc78): created successfully Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b60e25-5300-4497-a277-84fc6be22894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Flow 'volume_create_manager' (4a30cafc-1b9c-4f39-9050-8e2d66dcb9ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:53 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-330da8d7-953a-4399-90a2-81e6c99853b3 tempest-SnapshotDependencyTests-858121715 None] Created volume successfully. Apr 15 16:12:53 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" returned: 0 in 0.489s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:53 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387 Apr 15 16:12:53 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:53 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 1073741824" returned: 0 in 0.487s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:54 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 Apr 15 16:12:54 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:54 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" returned: 0 in 0.409s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Lock "cinder-quobyte-3319ce8c-0e75-40ae-a3b9-3bc0a4f01387" released by "delete_volume" :: held 0.930s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['e1f2665e-a4fc-4ed1-9772-85ffbaa22209'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:54 devstack cinder-volume[82392]: WARNING cinder.quota [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-864511120 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-864511120, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Created reservations ['d3b0dc17-b88f-4bec-b10e-c3d2e1af4976', '213edde3-ae2f-401d-b365-bc03cf29f6dd', '666942e1-34ec-48b7-b8ee-c826ea75cc3a', 'b635ea25-0aaf-4310-89d2-259d1312d610'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:54 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:54 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:54 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c4fa26-542e-42ff-8c46-f88bbaeae28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb1703c-a129-4b3e-b00f-93c905746d74', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f38ff71-aff1-4338-a063-2eecb7a4b7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:54 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume volume-deb1703c-a129-4b3e-b00f-93c905746d74 (deb1703c-a129-4b3e-b00f-93c905746d74): created successfully Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f38ff71-aff1-4338-a063-2eecb7a4b7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (b1cf0d26-6419-4505-89e8-2667b1c22d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:54 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1b56c590-7987-4259-9b6c-84ab897bb5be tempest-CreateVolumesFromSnapshotTest-989501343 None] Created volume successfully. Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-7b7e5e84-e6b7-47e5-a10c-53bed759c71b-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-7b7e5e84-e6b7-47e5-a10c-53bed759c71b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-quobyte-a7224bcd-e901-42fe-9b80-254f17170999" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-a7224bcd-e901-42fe-9b80-254f17170999" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-quobyte-7b7e5e84-e6b7-47e5-a10c-53bed759c71b" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-7b7e5e84-e6b7-47e5-a10c-53bed759c71b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Deleting offline snapshot 7b7e5e84-e6b7-47e5-a10c-53bed759c71b of volume a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] snapshot_file for this snap is: volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4c923a-0e61-403e-a4d6-197e3d44b4e7]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:54 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b Apr 15 16:12:54 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:54 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.515s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:54 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:54 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6655c33f-99a0-4647-9192-c6daba4ab467 tempest-GroupSnapshotsTest-1095581999 None] Delete group completed successfully. Apr 15 16:12:55 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b" returned: 0 in 0.539s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7224bcd-e901-42fe-9b80-254f17170999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2564b2c2-b6a3-4f06-bdb6-2ea634fbeb8c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:55 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 Apr 15 16:12:55 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Creating offline snapshot 98f4171c-5efd-4b07-9296-5e7d03a0e7c5 of volume deb1703c-a129-4b3e-b00f-93c905746d74 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[add900e2-c71d-468c-8f3d-51e2874e7374]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:55 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 Apr 15 16:12:55 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:55 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999" returned: 0 in 0.595s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:55 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b Apr 15 16:12:55 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:56 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74" returned: 0 in 0.531s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:56 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 1G Apr 15 16:12:56 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:56 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b" returned: 0 in 0.495s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:56 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b Apr 15 16:12:56 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:56 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999.7b7e5e84-e6b7-47e5-a10c-53bed759c71b" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-7b7e5e84-e6b7-47e5-a10c-53bed759c71b" released by "_delete_snapshot" :: held 2.141s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-a7224bcd-e901-42fe-9b80-254f17170999" released by "delete_snapshot" :: held 2.151s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:56 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 1G" returned: 0 in 0.607s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb1703c-a129-4b3e-b00f-93c905746d74 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Created reservations ['df4419ab-d590-488c-a75a-998e1c7f7f90', '82c80c6c-098f-454f-b552-c44eb95684e3', 'db87a34d-48f5-4732-862c-e8fa21d7a793', '12469ece-6065-433c-baf5-ca8a6746f34b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:56 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb1703c-a129-4b3e-b00f-93c905746d74 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 Apr 15 16:12:56 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:56 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Delete snapshot completed successfully. Apr 15 16:12:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e6792dd6-6d27-4384-b588-a46ffe3c6c7a tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-7b7e5e84-e6b7-47e5-a10c-53bed759c71b-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:57 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb1703c-a129-4b3e-b00f-93c905746d74 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5" returned: 0 in 0.489s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:57 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 is being set with open permissions: ugo+rw Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:57 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 Apr 15 16:12:57 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d562b295-aaa4-4537-bfbb-e5ea7d4acd05 tempest-GroupSnapshotsV319Test-1801246432 None] Group tempest-GroupSnapshotsV319Test-Group-240373322: creating Apr 15 16:12:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d562b295-aaa4-4537-bfbb-e5ea7d4acd05 tempest-GroupSnapshotsV319Test-1801246432 None] Group tempest-GroupSnapshotsV319Test-Group-240373322: created successfully Apr 15 16:12:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d562b295-aaa4-4537-bfbb-e5ea7d4acd05 tempest-GroupSnapshotsV319Test-1801246432 None] Create group completed successfully. Apr 15 16:12:57 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-a7224bcd-e901-42fe-9b80-254f17170999-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5" returned: 0 in 0.464s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-a7224bcd-e901-42fe-9b80-254f17170999-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:57 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.info Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-quobyte-a7224bcd-e901-42fe-9b80-254f17170999" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:57 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-a7224bcd-e901-42fe-9b80-254f17170999" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b380af3e-3eed-445e-b87c-bfa2ffe6d4b3]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:12:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:57 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 Apr 15 16:12:57 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:58 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.info" returned: 0 in 0.419s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:58 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.info is being set with open permissions: ugo+rw Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:58 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.info Apr 15 16:12:58 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:58 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999" returned: 0 in 0.470s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:58 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999 Apr 15 16:12:58 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:58 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.info" returned: 0 in 0.434s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.024s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:58 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-391f3ff4-5ab2-4c99-9f19-e90430f1a56e tempest-CreateVolumesFromSnapshotTest-989501343 None] Create snapshot completed successfully Apr 15 16:12:58 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a7224bcd-e901-42fe-9b80-254f17170999" returned: 0 in 0.444s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Flow 'volume_create_manager' (9c3093ba-a3ca-4e30-89df-40c45101af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1efb7bd-4d45-41f2-9275-cf358ff45f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-a7224bcd-e901-42fe-9b80-254f17170999" released by "delete_volume" :: held 0.974s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1efb7bd-4d45-41f2-9275-cf358ff45f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1986160458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36c9e1cb-5eb5-4087-bf25-f5113939e74a,host='devstack@QuobyteHD#QuobyteHD',id=c6373bb9-e131-4523-93f7-8372d4c775cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bd6b28acc04bcea0d559e431dc2864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:59Z,use_quota=True,user_id='d0e5b1a57fb449db8ab7ae0eec2d7dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a17a4139-d6d8-4c34-83fb-0895ec3635ee),volume_type_id=a17a4139-d6d8-4c34-83fb-0895ec3635ee)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bbe18b-b6ee-410a-bbe1-5d994b1e2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bbe18b-b6ee-410a-bbe1-5d994b1e2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833cb87a-375d-4508-be65-36e54e67c29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833cb87a-375d-4508-be65-36e54e67c29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6373bb9-e131-4523-93f7-8372d4c775cb', 'volume_name': 'volume-c6373bb9-e131-4523-93f7-8372d4c775cb', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd4e0ba-d890-4ba0-874e-615412f72f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd4e0ba-d890-4ba0-874e-615412f72f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e17018-c5cb-4f33-9f22-6af9a0ecede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:58 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Volume c6373bb9-e131-4523-93f7-8372d4c775cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6373bb9-e131-4523-93f7-8372d4c775cb', 'volume_size': 1} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36c9e1cb-5eb5-4087-bf25-f5113939e74a,created_at=2026-04-15T14:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1986160458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36c9e1cb-5eb5-4087-bf25-f5113939e74a,host='devstack@QuobyteHD#QuobyteHD',id=c6373bb9-e131-4523-93f7-8372d4c775cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bd6b28acc04bcea0d559e431dc2864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:12:59Z,use_quota=True,user_id='d0e5b1a57fb449db8ab7ae0eec2d7dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a17a4139-d6d8-4c34-83fb-0895ec3635ee),volume_type_id=a17a4139-d6d8-4c34-83fb-0895ec3635ee)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Creating volume c6373bb9-e131-4523-93f7-8372d4c775cb {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:12:58 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:58 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb 1073741824 Apr 15 16:12:58 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Created reservations ['0caec831-3602-4948-b233-8f82077fa83e', '10805efd-1b91-4903-ac97-f472f0ef302b', '28759828-718d-4d0e-9130-5ef1318e56c2', '5ffcb825-e6d0-4f01-bb23-47469d3b46bc'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:58 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:12:58 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:59 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb 1073741824" returned: 0 in 0.510s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:59 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:12:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Deleted volume successfully. Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8230e26-1802-49a6-bec5-efbdaddb9aaa tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-a7224bcd-e901-42fe-9b80-254f17170999-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:12:59 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb Apr 15 16:12:59 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:12:59 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e17018-c5cb-4f33-9f22-6af9a0ecede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6373bb9-e131-4523-93f7-8372d4c775cb', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3bcd48-513b-4247-a2cc-3400131cf217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:12:59 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Volume volume-c6373bb9-e131-4523-93f7-8372d4c775cb (c6373bb9-e131-4523-93f7-8372d4c775cb): created successfully Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3bcd48-513b-4247-a2cc-3400131cf217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Flow 'volume_create_manager' (9c3093ba-a3ca-4e30-89df-40c45101af7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f6b0377a-6650-485a-9444-c6e5c8ecc28b tempest-GroupSnapshotsV319Test-1801246432 None] Created volume successfully. Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-9efba507-761b-4637-a325-e19a37d3dc78-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-9efba507-761b-4637-a325-e19a37d3dc78-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "cinder-quobyte-9efba507-761b-4637-a325-e19a37d3dc78" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-9efba507-761b-4637-a325-e19a37d3dc78" acquired by "delete_volume" :: waited 0.019s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (308c24d3-3cb5-44cf-b866-5649227341bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:12:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af2199a-d273-4b69-b804-bf4d69faf069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1586778-c404-4d10-a96b-cd05c56033f6]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af2199a-d273-4b69-b804-bf4d69faf069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-77373941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b4608b-7ccd-43c8-a038-895c68d3a842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:00Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40f4f21-654b-4fd1-97f8-b394c8bef3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40f4f21-654b-4fd1-97f8-b394c8bef3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f05660-825a-4032-ad70-9980cbe5f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f05660-825a-4032-ad70-9980cbe5f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b4608b-7ccd-43c8-a038-895c68d3a842', 'volume_name': 'volume-a1b4608b-7ccd-43c8-a038-895c68d3a842', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9b8219-bdf9-4785-8a1f-9b8d2616c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9b8219-bdf9-4785-8a1f-9b8d2616c438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5baaf7af-d614-421c-94d0-ccc14afb163c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume a1b4608b-7ccd-43c8-a038-895c68d3a842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b4608b-7ccd-43c8-a038-895c68d3a842', 'volume_size': 1} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-77373941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b4608b-7ccd-43c8-a038-895c68d3a842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:00Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Creating volume a1b4608b-7ccd-43c8-a038-895c68d3a842 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:00 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:00 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 1073741824 Apr 15 16:13:00 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:00 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 Apr 15 16:13:00 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (0e4bc329-e4d6-4949-9cc4-06ff7d9e7135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48536a1f-cd1a-4a20-b3ce-dac33c5b250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48536a1f-cd1a-4a20-b3ce-dac33c5b250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-489377084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac652df-f86e-4ad6-8c67-79f6359b2b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:00Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4110bb32-8a4d-4ff4-9feb-592ec72ad330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4110bb32-8a4d-4ff4-9feb-592ec72ad330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db1191-9e8d-4f09-ae46-6e88d6417362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db1191-9e8d-4f09-ae46-6e88d6417362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac652df-f86e-4ad6-8c67-79f6359b2b0e', 'volume_name': 'volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3fb94b-595a-4c53-8766-497536324dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3fb94b-595a-4c53-8766-497536324dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfc078e-fd8a-4c68-b514-e13814800ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume 5ac652df-f86e-4ad6-8c67-79f6359b2b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e', 'volume_size': 1} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (9ed65d85-4df2-4757-aa59-0d8ad1aed3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b11c6b-25fd-498a-9404-3985185bdf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b11c6b-25fd-498a-9404-3985185bdf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080510668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a959b1b8-17ee-4874-baa9-898197e4b2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:00Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24a349c-8789-4313-bdf1-dc303216e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24a349c-8789-4313-bdf1-dc303216e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba4bc09-b82f-4c76-948f-c285a13508bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba4bc09-b82f-4c76-948f-c285a13508bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a959b1b8-17ee-4874-baa9-898197e4b2fd', 'volume_name': 'volume-a959b1b8-17ee-4874-baa9-898197e4b2fd', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347bcf01-022b-4eef-8f88-dee5a2fa6e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347bcf01-022b-4eef-8f88-dee5a2fa6e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67e055b-8f1b-437a-a72b-258d57cbcd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume a959b1b8-17ee-4874-baa9-898197e4b2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a959b1b8-17ee-4874-baa9-898197e4b2fd', 'volume_size': 1} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (d42c5167-317d-4937-9dfd-7b0148e15bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd222d6-dca3-495d-8cb6-48347c771486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd222d6-dca3-495d-8cb6-48347c771486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700515146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c596dd-2dcd-421f-9ab3-9b17b2f02d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:00Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a154536-b322-4d5b-85f7-05802d562ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a154536-b322-4d5b-85f7-05802d562ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8806300e-4db0-4280-a407-b02becc13be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8806300e-4db0-4280-a407-b02becc13be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c596dd-2dcd-421f-9ab3-9b17b2f02d78', 'volume_name': 'volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb733e1d-995e-473e-be87-a9e01c1dc46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb733e1d-995e-473e-be87-a9e01c1dc46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54574209-fbd1-4b7d-966a-7a2a464dbdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume 66c596dd-2dcd-421f-9ab3-9b17b2f02d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78', 'volume_size': 1} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:00 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 1073741824" returned: 0 in 0.599s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:00 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78" returned: 0 in 0.618s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:00 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78 Apr 15 16:13:00 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:00 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 Apr 15 16:13:00 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (a7dbd0fb-d90b-41df-a246-aa6da521fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d851a45-216f-401e-8624-5ca224530ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d851a45-216f-401e-8624-5ca224530ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640126571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cda501-cffc-4e4e-9001-390096b0d682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:01Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc24cd75-964a-45a2-b6df-046deaea4e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc24cd75-964a-45a2-b6df-046deaea4e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be14107-42ba-4acc-a270-9ef6852b98c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be14107-42ba-4acc-a270-9ef6852b98c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70cda501-cffc-4e4e-9001-390096b0d682', 'volume_name': 'volume-70cda501-cffc-4e4e-9001-390096b0d682', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dceca20-7804-4f13-9bb3-7232b657eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dceca20-7804-4f13-9bb3-7232b657eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63be9fd1-5eb9-47c1-bab2-be47aabcb3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume 70cda501-cffc-4e4e-9001-390096b0d682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70cda501-cffc-4e4e-9001-390096b0d682', 'volume_size': 1} Apr 15 16:13:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] GroupSnapshot d6f03008-a2af-4815-ac8c-70cf5a8954cb: creating. Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Group snapshot d6f03008-a2af-4815-ac8c-70cf5a8954cb: creating. {{(pid=82392) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:01 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.886s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-489377084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac652df-f86e-4ad6-8c67-79f6359b2b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:00Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Creating volume 5ac652df-f86e-4ad6-8c67-79f6359b2b0e {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:01 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:01 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9efba507-761b-4637-a325-e19a37d3dc78" returned: 0 in 0.499s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:01 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e 1073741824 Apr 15 16:13:01 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5baaf7af-d614-421c-94d0-ccc14afb163c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b4608b-7ccd-43c8-a038-895c68d3a842', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b40a60-c3fa-4c56-8b74-f162303f9f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:01 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 (a1b4608b-7ccd-43c8-a038-895c68d3a842): created successfully Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b40a60-c3fa-4c56-8b74-f162303f9f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (308c24d3-3cb5-44cf-b866-5649227341bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-quobyte-9efba507-761b-4637-a325-e19a37d3dc78" released by "delete_volume" :: held 1.237s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5c455a69-2c85-44a1-b621-ed7a8e8898be tempest-CreateVolumesFromSnapshotTest-989501343 None] Created volume successfully. Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Created reservations ['4ed842f9-f95b-4004-b103-9b46b6ab7cd5', '0f783f5e-21be-4b75-97ee-5d951a50b31f', 'f12d38e8-6df8-44ef-83c5-fbe48fc3c913', 'c23d5256-1d85-48f7-be74-00c918617585'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:01 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:01 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:01 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e 1073741824" returned: 0 in 0.494s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:01 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e Apr 15 16:13:01 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:01 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.441s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Deleted volume successfully. Apr 15 16:13:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-82f6de45-9051-41be-bbc7-f3a4bc98b9f8 tempest-SnapshotDependencyTests-858121715 None] Lock "cinder-9efba507-761b-4637-a325-e19a37d3dc78-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:02 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e" returned: 0 in 0.426s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080510668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a959b1b8-17ee-4874-baa9-898197e4b2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:00Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Creating volume a959b1b8-17ee-4874-baa9-898197e4b2fd {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:02 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:02 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd 1073741824 Apr 15 16:13:02 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfc078e-fd8a-4c68-b514-e13814800ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ecb14d-6207-4903-8323-66dd2a20a4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:02 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e (5ac652df-f86e-4ad6-8c67-79f6359b2b0e): created successfully Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ecb14d-6207-4903-8323-66dd2a20a4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (0e4bc329-e4d6-4949-9cc4-06ff7d9e7135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:02 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c7435866-b8e6-4204-8fe1-18ddab45e83f tempest-CreateVolumesFromSnapshotTest-989501343 None] Created volume successfully. Apr 15 16:13:02 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd 1073741824" returned: 0 in 0.488s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:02 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd Apr 15 16:13:02 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:03 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd" returned: 0 in 0.507s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700515146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c596dd-2dcd-421f-9ab3-9b17b2f02d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:00Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Creating volume 66c596dd-2dcd-421f-9ab3-9b17b2f02d78 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:03 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67e055b-8f1b-437a-a72b-258d57cbcd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a959b1b8-17ee-4874-baa9-898197e4b2fd', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:03 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 1073741824 Apr 15 16:13:03 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1858fd62-e7be-45f3-af17-8e6860186b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:03 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume volume-a959b1b8-17ee-4874-baa9-898197e4b2fd (a959b1b8-17ee-4874-baa9-898197e4b2fd): created successfully Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1858fd62-e7be-45f3-af17-8e6860186b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (9ed65d85-4df2-4757-aa59-0d8ad1aed3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:03 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-08286975-f9fa-47ee-b70c-4a581b1ff5ae tempest-CreateVolumesFromSnapshotTest-989501343 None] Created volume successfully. Apr 15 16:13:03 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 1073741824" returned: 0 in 0.517s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:03 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 Apr 15 16:13:03 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:04 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:04 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:04 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78" returned: 0 in 0.510s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.432s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640126571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cda501-cffc-4e4e-9001-390096b0d682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97916d13f68844aa974970c002c96772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:01Z,use_quota=True,user_id='21845c3e25a14c0696e81bbda59d3cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Creating volume 70cda501-cffc-4e4e-9001-390096b0d682 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:04 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54574209-fbd1-4b7d-966a-7a2a464dbdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:04 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 1073741824 Apr 15 16:13:04 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84a1c56-f13f-4cfd-a8d7-9f7498046683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:04 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 (66c596dd-2dcd-421f-9ab3-9b17b2f02d78): created successfully Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84a1c56-f13f-4cfd-a8d7-9f7498046683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (d42c5167-317d-4937-9dfd-7b0148e15bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:04 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-49a3943c-d03e-436e-855a-77acc55f95dd tempest-CreateVolumesFromSnapshotTest-989501343 None] Created volume successfully. Apr 15 16:13:04 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.551s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:04 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 1073741824" returned: 0 in 0.586s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:04 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 Apr 15 16:13:04 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:05 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.271s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Creating offline snapshot 17c8a862-fa36-4a0d-b4f6-652d7d9004dc of volume c6373bb9-e131-4523-93f7-8372d4c775cb {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63be9fd1-5eb9-47c1-bab2-be47aabcb3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70cda501-cffc-4e4e-9001-390096b0d682', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0529f7f-8119-44de-bfd1-bf9bdf9f4a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe130cbe-851d-4777-be68-4870e9c28b8d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:05 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Volume volume-70cda501-cffc-4e4e-9001-390096b0d682 (70cda501-cffc-4e4e-9001-390096b0d682): created successfully Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0529f7f-8119-44de-bfd1-bf9bdf9f4a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Flow 'volume_create_manager' (a7dbd0fb-d90b-41df-a246-aa6da521fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:05 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0088a56e-1e97-4be4-95ad-a5c9951d24e8 tempest-CreateVolumesFromSnapshotTest-989501343 None] Created volume successfully. Apr 15 16:13:05 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb Apr 15 16:13:05 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:05 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb" returned: 0 in 0.551s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:05 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc 1G Apr 15 16:13:05 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-70cda501-cffc-4e4e-9001-390096b0d682-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-70cda501-cffc-4e4e-9001-390096b0d682-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-quobyte-70cda501-cffc-4e4e-9001-390096b0d682" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-70cda501-cffc-4e4e-9001-390096b0d682" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[784253bf-33bd-4250-b72d-c70c69a34d13]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:06 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 Apr 15 16:13:06 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:06 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc 1G" returned: 0 in 0.585s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6373bb9-e131-4523-93f7-8372d4c775cb -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:06 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6373bb9-e131-4523-93f7-8372d4c775cb -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc Apr 15 16:13:06 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:06 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682" returned: 0 in 0.597s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:06 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682 Apr 15 16:13:06 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:07 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6373bb9-e131-4523-93f7-8372d4c775cb -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc" returned: 0 in 0.551s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:07 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:07 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc Apr 15 16:13:07 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:07 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-70cda501-cffc-4e4e-9001-390096b0d682" returned: 0 in 0.504s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-70cda501-cffc-4e4e-9001-390096b0d682" released by "delete_volume" :: held 1.128s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:DELETE=21,cinder:SELECT=251,cinder:INSERT=90,cinder:UPDATE=300 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:UPDATE=280,cinder:SELECT=232,cinder:INSERT=56,cinder:DELETE=20 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:13:07 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc" returned: 0 in 0.478s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Created reservations ['588b9aa0-43f5-4ca4-a190-6868533de38b', 'bde0d786-4334-4a41-b1d1-3a8a85b4847e', '9e77d305-b4e4-487f-8bed-b5ccac7c3a8f', 'c4a0a163-da38-49c1-ac46-398aca268b4a'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:07 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.info Apr 15 16:13:07 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:07 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:07 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:08 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.info" returned: 0 in 0.475s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:08 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:08 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.info Apr 15 16:13:08 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:08 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.499s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:08 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Deleted volume successfully. Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5971574b-4e0a-495d-a1c9-0dda94b6dea3 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-70cda501-cffc-4e4e-9001-390096b0d682-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:08 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.info" returned: 0 in 0.464s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.192s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-66c596dd-2dcd-421f-9ab3-9b17b2f02d78-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-66c596dd-2dcd-421f-9ab3-9b17b2f02d78-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-quobyte-66c596dd-2dcd-421f-9ab3-9b17b2f02d78" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-66c596dd-2dcd-421f-9ab3-9b17b2f02d78" acquired by "delete_volume" :: waited 0.026s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:08 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-3febffd1-a547-482d-acde-103325caa724 tempest-GroupSnapshotsV319Test-1801246432 None] group_snapshot d6f03008-a2af-4815-ac8c-70cf5a8954cb: created successfully Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fba635-a35b-4ac9-949b-5574756f5870]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:08 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 Apr 15 16:13:08 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:09 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78" returned: 0 in 0.481s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:09 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78 Apr 15 16:13:09 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:09 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-66c596dd-2dcd-421f-9ab3-9b17b2f02d78" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-66c596dd-2dcd-421f-9ab3-9b17b2f02d78" released by "delete_volume" :: held 0.936s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Created reservations ['00dd266c-ad92-4d9e-92eb-81c85a0af45a', 'c8faf25a-c6d6-40ea-ba20-282ccec66767', 'bfa81597-9522-44f6-888c-2a608f4f8cb5', '8682b0ea-dbdc-4f73-a22e-2d26e8594863'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:09 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] group_snapshot d6f03008-a2af-4815-ac8c-70cf5a8954cb: deleting Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] group_snapshot d6f03008-a2af-4815-ac8c-70cf5a8954cb: deleting {{(pid=82392) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 16:13:09 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-a959b1b8-17ee-4874-baa9-898197e4b2fd-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:09 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-a959b1b8-17ee-4874-baa9-898197e4b2fd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-quobyte-a959b1b8-17ee-4874-baa9-898197e4b2fd" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Acquiring lock "cinder-quobyte-c6373bb9-e131-4523-93f7-8372d4c775cb" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-a959b1b8-17ee-4874-baa9-898197e4b2fd" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Lock "cinder-quobyte-c6373bb9-e131-4523-93f7-8372d4c775cb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Acquiring lock "cinder-quobyte-17c8a862-fa36-4a0d-b4f6-652d7d9004dc" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[386bceee-6b4f-4f29-ad8f-3f650a40c438]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Lock "cinder-quobyte-17c8a862-fa36-4a0d-b4f6-652d7d9004dc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Deleting offline snapshot 17c8a862-fa36-4a0d-b4f6-652d7d9004dc of volume c6373bb9-e131-4523-93f7-8372d4c775cb {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] snapshot_file for this snap is: volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42357ac-53a4-4cfe-9463-1fa66e06b249]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:09 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd Apr 15 16:13:09 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:09 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc Apr 15 16:13:09 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:10 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Deleted volume successfully. Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-91fd1512-fcd8-4e23-ab99-bd5612968143 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-66c596dd-2dcd-421f-9ab3-9b17b2f02d78-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:10 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd" returned: 0 in 0.505s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:10 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc" returned: 0 in 0.481s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6373bb9-e131-4523-93f7-8372d4c775cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:10 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd Apr 15 16:13:10 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6c5dd0-b3de-4ca6-b7ca-deaaa86d2013]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:10 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb Apr 15 16:13:10 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:10 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a959b1b8-17ee-4874-baa9-898197e4b2fd" returned: 0 in 0.416s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-a959b1b8-17ee-4874-baa9-898197e4b2fd" released by "delete_volume" :: held 0.946s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Created reservations ['e87ce5e8-422e-44f7-a6f7-47c9d19d67f2', '927f1b11-6537-4e04-ba7d-2c4412f6c38d', '149eb084-ad49-4725-8813-830bd0dd61b7', '547a32c4-ad00-4035-9ca0-981725934111'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:10 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb" returned: 0 in 0.509s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:10 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:10 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:10 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-5ac652df-f86e-4ad6-8c67-79f6359b2b0e-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:10 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-5ac652df-f86e-4ad6-8c67-79f6359b2b0e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-quobyte-5ac652df-f86e-4ad6-8c67-79f6359b2b0e" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-5ac652df-f86e-4ad6-8c67-79f6359b2b0e" acquired by "delete_volume" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b0f370-c601-4e21-b030-0d522966d720]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:10 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e Apr 15 16:13:10 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:11 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.434s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:11 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Deleted volume successfully. Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8887e8d2-8433-48b1-a33f-ce4888b76b92 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-a959b1b8-17ee-4874-baa9-898197e4b2fd-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:11 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:11 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc Apr 15 16:13:11 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:11 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e" returned: 0 in 0.489s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:11 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e Apr 15 16:13:11 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:11 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb.17c8a862-fa36-4a0d-b4f6-652d7d9004dc" returned: 0 in 0.415s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Lock "cinder-quobyte-17c8a862-fa36-4a0d-b4f6-652d7d9004dc" released by "_delete_snapshot" :: held 1.937s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Lock "cinder-quobyte-c6373bb9-e131-4523-93f7-8372d4c775cb" released by "delete_snapshot" :: held 1.959s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:11 devstack cinder-volume[82392]: WARNING cinder.quota [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1227971763 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1227971763, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:13:11 devstack cinder-volume[82392]: WARNING cinder.quota [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1227971763 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1227971763, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] Created reservations ['ba01c442-50d8-4355-8bf2-52626cbe1bd1', '84adba15-a15b-4ad6-967c-b979b1fb6bbb', '47efe69e-c40d-4fcd-a3ce-bfc073775fc5', '17d51ff5-bd3c-4689-9728-b920a3823e25'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:11 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5ac652df-f86e-4ad6-8c67-79f6359b2b0e" returned: 0 in 0.439s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-5ac652df-f86e-4ad6-8c67-79f6359b2b0e" released by "delete_volume" :: held 0.952s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:11 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a9bfdce1-d7bc-4c1d-bb03-680adbd0f6ad tempest-GroupSnapshotsV319Test-1801246432 None] group_snapshot d6f03008-a2af-4815-ac8c-70cf5a8954cb: deleted successfully Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Created reservations ['b01ac61a-8b69-453a-b046-0c2f0f0f9f89', '6d94f965-e3b5-4cd4-863f-0dc5e8e60e1e', 'e5e2f753-a6fc-4771-9826-3b89e2ae2f3c', 'aefb2fb5-7128-492d-a4cb-1dd706ae4b69'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:11 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:11 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-a1b4608b-7ccd-43c8-a038-895c68d3a842-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-a1b4608b-7ccd-43c8-a038-895c68d3a842-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-quobyte-a1b4608b-7ccd-43c8-a038-895c68d3a842" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-a1b4608b-7ccd-43c8-a038-895c68d3a842" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a30a75b-fed0-4ffd-bd55-27bc729dd8bc]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:12 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 Apr 15 16:13:12 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:12 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.414s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:12 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Deleted volume successfully. Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8f659637-98e6-41df-b019-44b57f20f70d tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-5ac652df-f86e-4ad6-8c67-79f6359b2b0e-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:12 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:12 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842 Apr 15 16:13:12 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:12 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-a1b4608b-7ccd-43c8-a038-895c68d3a842" returned: 0 in 0.421s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-a1b4608b-7ccd-43c8-a038-895c68d3a842" released by "delete_volume" :: held 0.935s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Acquiring lock "cinder-quobyte-c6373bb9-e131-4523-93f7-8372d4c775cb" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Created reservations ['ca35ecb6-9866-49b9-8272-0ca9613c6148', '9f151483-c4ad-4838-b9f4-6106dcd17fdd', '77d3426e-3495-4f2d-856b-4f9695b9bc24', 'cde36452-5628-4d68-b687-7bcf6327ebf9'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Lock "cinder-quobyte-c6373bb9-e131-4523-93f7-8372d4c775cb" acquired by "delete_volume" :: waited 0.029s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde9d1b7-5c40-4fd0-8c72-cc0542087be1]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-98f4171c-5efd-4b07-9296-5e7d03a0e7c5-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:13 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:13 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-98f4171c-5efd-4b07-9296-5e7d03a0e7c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-quobyte-deb1703c-a129-4b3e-b00f-93c905746d74" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-deb1703c-a129-4b3e-b00f-93c905746d74" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-quobyte-98f4171c-5efd-4b07-9296-5e7d03a0e7c5" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-98f4171c-5efd-4b07-9296-5e7d03a0e7c5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Deleting offline snapshot 98f4171c-5efd-4b07-9296-5e7d03a0e7c5 of volume deb1703c-a129-4b3e-b00f-93c905746d74 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:13:13 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb Apr 15 16:13:13 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] snapshot_file for this snap is: volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[57246d84-510f-4929-97b5-0d3527efd310]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:13 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 Apr 15 16:13:13 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:13 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.417s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:13 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Deleted volume successfully. Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e584acc5-fd67-4576-bba2-ae15fc61b65b tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-a1b4608b-7ccd-43c8-a038-895c68d3a842-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:13 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb" returned: 0 in 0.503s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:13 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb Apr 15 16:13:13 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:13 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5" returned: 0 in 0.493s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deb1703c-a129-4b3e-b00f-93c905746d74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f451b654-92e6-43db-8ba3-b87559e85128]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:13 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 Apr 15 16:13:13 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:13 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6373bb9-e131-4523-93f7-8372d4c775cb" returned: 0 in 0.415s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Lock "cinder-quobyte-c6373bb9-e131-4523-93f7-8372d4c775cb" released by "delete_volume" :: held 0.956s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Created reservations ['e3e86022-31bc-4f97-a0ba-0a5f7ea44fd8'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:13 devstack cinder-volume[82392]: WARNING cinder.quota [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1227971763 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1227971763, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:13:13 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Created reservations ['c34b0859-8841-4d39-a015-ff997d43704b', '68d442ab-bce4-4eab-a579-3e659bfe5d27', 'cb75bda0-2c63-4b71-ac5c-f458f96c7fe2', 'd54fa7dc-f3b0-4cc4-b426-eb592589987a'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:14 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74" returned: 0 in 0.495s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:14 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:14 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:14 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 Apr 15 16:13:14 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:14 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.424s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c8ea55eb-22b6-4991-b8de-5b885530c04c tempest-GroupSnapshotsV319Test-1801246432 None] Delete group completed successfully. Apr 15 16:13:14 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5" returned: 0 in 0.444s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:14 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5 Apr 15 16:13:14 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:14 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74.98f4171c-5efd-4b07-9296-5e7d03a0e7c5" returned: 0 in 0.401s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-98f4171c-5efd-4b07-9296-5e7d03a0e7c5" released by "_delete_snapshot" :: held 1.889s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:14 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-deb1703c-a129-4b3e-b00f-93c905746d74" released by "delete_snapshot" :: held 1.901s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Created reservations ['98043530-d2e7-45b0-bd19-6fd042da4103', '542cfc2c-714f-4b51-b951-1c9e5edee433', 'd28002ea-2ed0-4f5a-86c8-ff9520874495', '94f3161d-236c-4f76-a7dd-bc2e9df71384'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:15 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Delete snapshot completed successfully. Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-77c6d153-c1e2-4ab5-9e54-2468f8658124 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-98f4171c-5efd-4b07-9296-5e7d03a0e7c5-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-deb1703c-a129-4b3e-b00f-93c905746d74-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-deb1703c-a129-4b3e-b00f-93c905746d74-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "cinder-quobyte-deb1703c-a129-4b3e-b00f-93c905746d74" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-deb1703c-a129-4b3e-b00f-93c905746d74" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[31560eb9-3d6f-44e6-b0b3-6b3720464547]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:15 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 Apr 15 16:13:15 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:15 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74" returned: 0 in 0.510s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:15 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74 Apr 15 16:13:15 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:16 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-deb1703c-a129-4b3e-b00f-93c905746d74" returned: 0 in 0.478s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-quobyte-deb1703c-a129-4b3e-b00f-93c905746d74" released by "delete_volume" :: held 1.021s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Created reservations ['e4ec2d05-572e-48b9-88ea-e9b296c4be63', '86bbe9d1-87ac-4d73-af27-3def2680d459', 'a4ce87eb-6c39-4529-97ff-7eb489465531', '13a59940-cf2d-4a09-8ec2-7ef5851979b2'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:16 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:16 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:16 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:16 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Deleted volume successfully. Apr 15 16:13:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-47d2cb03-15be-460c-8e45-17c378b29d55 tempest-CreateVolumesFromSnapshotTest-989501343 None] Lock "cinder-deb1703c-a129-4b3e-b00f-93c905746d74-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Flow 'volume_create_manager' (60d98aeb-bb1f-401b-adbb-555d25893b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b481887e-d6a0-4bf7-bf61-217cbaf21c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b481887e-d6a0-4bf7-bf61-217cbaf21c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1587091527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3463b2ff-d321-4ca7-8f27-73b7ba0e0431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d06e8b42764996b242df499c44f170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:19Z,use_quota=True,user_id='d1e9acc78d62409b8ea1fe5eed2151dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ed2685-8c33-4972-aeee-3907a1530cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ed2685-8c33-4972-aeee-3907a1530cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751fc822-ad23-4769-985c-6659e6ecc158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751fc822-ad23-4769-985c-6659e6ecc158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3463b2ff-d321-4ca7-8f27-73b7ba0e0431', 'volume_name': 'volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf63872-aa16-49c7-98ea-52b28addccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf63872-aa16-49c7-98ea-52b28addccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779b6019-5096-472a-9e45-96ade664a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:19 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Volume 3463b2ff-d321-4ca7-8f27-73b7ba0e0431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431', 'volume_size': 1} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1587091527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3463b2ff-d321-4ca7-8f27-73b7ba0e0431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d06e8b42764996b242df499c44f170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:19Z,use_quota=True,user_id='d1e9acc78d62409b8ea1fe5eed2151dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Creating volume 3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:19 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:19 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 1073741824 Apr 15 16:13:19 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:20 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 1073741824" returned: 0 in 0.552s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:20 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 Apr 15 16:13:20 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:20 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" returned: 0 in 0.464s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779b6019-5096-472a-9e45-96ade664a110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e7d4ae-d06d-49a2-96f5-76124b30d39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:20 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Volume volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 (3463b2ff-d321-4ca7-8f27-73b7ba0e0431): created successfully Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e7d4ae-d06d-49a2-96f5-76124b30d39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Flow 'volume_create_manager' (60d98aeb-bb1f-401b-adbb-555d25893b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-3b359ccb-4ccf-48ca-b454-2dbc2dbe8639 tempest-VolumeDependencyTests-1806237498 None] Created volume successfully. Apr 15 16:13:21 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a648fd4e-6198-471a-8826-712f94c6dcf8 tempest-GroupsTest-401836109 None] Group tempest-Group1-230413592: creating Apr 15 16:13:21 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a648fd4e-6198-471a-8826-712f94c6dcf8 tempest-GroupsTest-401836109 None] Group tempest-Group1-230413592: created successfully Apr 15 16:13:21 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a648fd4e-6198-471a-8826-712f94c6dcf8 tempest-GroupsTest-401836109 None] Create group completed successfully. Apr 15 16:13:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Creating offline snapshot fa532ac2-9dbc-4877-928d-76a881887521 of volume 3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:13:21 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e507f67-a8fb-4810-adb3-e7c2a580be29]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:21 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 Apr 15 16:13:21 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:22 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" returned: 0 in 0.467s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:22 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 1G Apr 15 16:13:22 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:22 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 1G" returned: 0 in 0.513s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:22 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f6294f6c-ccf3-48c7-a661-e70feff3bc82 tempest-GroupsTest-401836109 None] Group tempest-Group2-715679216: creating Apr 15 16:13:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:22 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 Apr 15 16:13:22 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:22 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f6294f6c-ccf3-48c7-a661-e70feff3bc82 tempest-GroupsTest-401836109 None] Group tempest-Group2-715679216: created successfully Apr 15 16:13:22 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f6294f6c-ccf3-48c7-a661-e70feff3bc82 tempest-GroupsTest-401836109 None] Create group completed successfully. Apr 15 16:13:23 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521" returned: 0 in 0.433s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:23 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 is being set with open permissions: ugo+rw Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:23 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 Apr 15 16:13:23 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:23 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521" returned: 0 in 0.405s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:23 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.info Apr 15 16:13:23 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:23 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.info" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:23 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.info is being set with open permissions: ugo+rw Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:23 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.info Apr 15 16:13:23 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Flow 'volume_create_manager' (72543bd7-0d4b-48cd-8c9f-fa40843a7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471e2460-c7de-49de-b497-6de93179ca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471e2460-c7de-49de-b497-6de93179ca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066615413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04588a2d-1585-4fbc-be46-3bba0b3bf51a,host='devstack@QuobyteHD#QuobyteHD',id=f4636727-380f-4116-8167-0b4ce6fe39c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403655ab58a348d4b47343433eab797d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:24Z,use_quota=True,user_id='29df86c4556b497bba0449cab7785af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(186fc683-15ee-442e-88c8-d614b3c88078),volume_type_id=186fc683-15ee-442e-88c8-d614b3c88078)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d8664e-0ff8-4404-b752-6b7b891255d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d8664e-0ff8-4404-b752-6b7b891255d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfff26b-d4a1-4eef-adfd-32280445eb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfff26b-d4a1-4eef-adfd-32280445eb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4636727-380f-4116-8167-0b4ce6fe39c6', 'volume_name': 'volume-f4636727-380f-4116-8167-0b4ce6fe39c6', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b086f566-fb56-4bf5-b5d2-5e475668334e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b086f566-fb56-4bf5-b5d2-5e475668334e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f7f396-4492-406d-bb3e-3e433d420201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:24 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Volume f4636727-380f-4116-8167-0b4ce6fe39c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4636727-380f-4116-8167-0b4ce6fe39c6', 'volume_size': 1} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:24 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.info" returned: 0 in 0.413s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=04588a2d-1585-4fbc-be46-3bba0b3bf51a,created_at=2026-04-15T14:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066615413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04588a2d-1585-4fbc-be46-3bba0b3bf51a,host='devstack@QuobyteHD#QuobyteHD',id=f4636727-380f-4116-8167-0b4ce6fe39c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403655ab58a348d4b47343433eab797d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:24Z,use_quota=True,user_id='29df86c4556b497bba0449cab7785af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(186fc683-15ee-442e-88c8-d614b3c88078),volume_type_id=186fc683-15ee-442e-88c8-d614b3c88078)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Creating volume f4636727-380f-4116-8167-0b4ce6fe39c6 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:24 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:24 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 1073741824 Apr 15 16:13:24 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:24 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d3a26ae5-7331-4aeb-a1cb-bd8e56d9bb06 tempest-VolumeDependencyTests-1806237498 None] Create snapshot completed successfully Apr 15 16:13:24 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 1073741824" returned: 0 in 0.503s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:24 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 Apr 15 16:13:24 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Flow 'volume_create_manager' (7dd405e8-d9b0-4b6d-84ad-72ae0cebed63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bdd51f-2d21-469a-901e-a9425e557297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bdd51f-2d21-469a-901e-a9425e557297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1641886021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5d695a-e2a2-4266-90d9-dbb211a95ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d06e8b42764996b242df499c44f170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa532ac2-9dbc-4877-928d-76a881887521,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:25Z,use_quota=True,user_id='d1e9acc78d62409b8ea1fe5eed2151dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5da39e-2d54-4bc4-8173-860696e8fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5da39e-2d54-4bc4-8173-860696e8fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a73026c-c44d-4029-8e37-7d180614878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a73026c-c44d-4029-8e37-7d180614878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d5d695a-e2a2-4266-90d9-dbb211a95ab6', 'volume_name': 'volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6', 'volume_size': 1, 'snapshot_id': 'fa532ac2-9dbc-4877-928d-76a881887521'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83987adb-5b24-44bf-b102-9e2e71044365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83987adb-5b24-44bf-b102-9e2e71044365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4970142-23da-49d5-946a-07b60eefc75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:25 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Volume 2d5d695a-e2a2-4266-90d9-dbb211a95ab6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6', 'volume_size': 1, 'snapshot_id': 'fa532ac2-9dbc-4877-928d-76a881887521'} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:25 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.247s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-fa532ac2-9dbc-4877-928d-76a881887521-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" by "_create_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f7f396-4492-406d-bb3e-3e433d420201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4636727-380f-4116-8167-0b4ce6fe39c6', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec453ef-5414-4f50-b3e4-3c7b86581914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:25 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Volume volume-f4636727-380f-4116-8167-0b4ce6fe39c6 (f4636727-380f-4116-8167-0b4ce6fe39c6): created successfully Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec453ef-5414-4f50-b3e4-3c7b86581914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Flow 'volume_create_manager' (72543bd7-0d4b-48cd-8c9f-fa40843a7360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-fa532ac2-9dbc-4877-928d-76a881887521-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Creating volume 2d5d695a-e2a2-4266-90d9-dbb211a95ab6 from snapshot fa532ac2-9dbc-4877-928d-76a881887521 {{(pid=82392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:25 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a15b8e7e-2c51-41af-8cd8-43f6a4fb901d tempest-GroupsTest-401836109 None] Created volume successfully. Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] snapshot: fa532ac2-9dbc-4877-928d-76a881887521, volume: 2d5d695a-e2a2-4266-90d9-dbb211a95ab6, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b764c85-0739-4f4e-a620-f109e6c12aa9]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:25 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 Apr 15 16:13:25 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:25 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521" returned: 0 in 0.470s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d98a210-9d04-4bd8-b7de-e917d95cde6d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:25 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 Apr 15 16:13:25 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Acquiring lock "cinder-quobyte-f4636727-380f-4116-8167-0b4ce6fe39c6" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Lock "cinder-quobyte-f4636727-380f-4116-8167-0b4ce6fe39c6" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24831b4-3047-44f2-aa05-6881fd4ecaae]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:26 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" returned: 0 in 0.521s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:26 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 Apr 15 16:13:26 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:26 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 Apr 15 16:13:26 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:26 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6" returned: 0 in 0.535s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:27 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6 Apr 15 16:13:27 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:27 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f4636727-380f-4116-8167-0b4ce6fe39c6" returned: 0 in 0.826s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Lock "cinder-quobyte-f4636727-380f-4116-8167-0b4ce6fe39c6" released by "delete_volume" :: held 1.393s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:27 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Created reservations ['c36afa84-fa92-450a-a7db-34f39c972ff2'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:27 devstack cinder-volume[82392]: WARNING cinder.quota [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1234959857 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1234959857, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:13:27 devstack cinder-volume[82392]: WARNING cinder.quota [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1234959857 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1234959857, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:13:27 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Created reservations ['48aa2a4a-0bc2-4990-a071-3d84374e8bd9', '88c8aca1-7acf-4a27-bc50-698eb756c652', 'e31966a1-76d0-416a-a320-ce34a50b9edb', '393137d0-54c7-4cb0-a4fb-15a7662755cb'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:28 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:28 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:28 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" returned: 0 in 2.126s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a19fec0-bf8e-4eed-9802-2c4283d48dc2]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:28 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 Apr 15 16:13:28 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Created reservations ['f050b859-6b69-46a6-805e-2e14a14f0fc7'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:28 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:28 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:28 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.666s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:28 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:28 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d3cdf6b7-ed76-41d3-a51e-fed1288c17b2 tempest-GroupsTest-401836109 None] Delete group completed successfully. Apr 15 16:13:29 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.404s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:29 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-cc7c97f3-3ac2-4285-b428-8515318d40a4 tempest-GroupsTest-401836109 None] Delete group completed successfully. Apr 15 16:13:29 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" returned: 0 in 0.612s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:13:29 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Converted 1024.00 MB image at 481.25 MB/s Apr 15 16:13:29 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 is being set with open permissions: ugo+rw Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:29 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 Apr 15 16:13:29 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:29 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" returned: 0 in 0.394s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" released by "_copy_volume_from_snapshot" :: held 4.201s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-fa532ac2-9dbc-4877-928d-76a881887521-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" released by "_create_volume_from_snapshot" :: held 4.222s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.253s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4970142-23da-49d5-946a-07b60eefc75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6', 'volume_size': 1, 'snapshot_id': 'fa532ac2-9dbc-4877-928d-76a881887521'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3270e3-4b31-43cd-af6b-eed961f8f4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:29 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Volume volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 (2d5d695a-e2a2-4266-90d9-dbb211a95ab6): created successfully Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3270e3-4b31-43cd-af6b-eed961f8f4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:29 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Flow 'volume_create_manager' (7dd405e8-d9b0-4b6d-84ad-72ae0cebed63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:29 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a799e078-c1cf-4330-996b-589c5d2d12b6 tempest-VolumeDependencyTests-1806237498 None] Created volume successfully. Apr 15 16:13:30 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-cf0456a9-198f-44d5-b281-018d5ea731f8 tempest-GroupsTest-401836109 None] Group tempest-GroupsTest-Group-1064066811: creating Apr 15 16:13:30 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-cf0456a9-198f-44d5-b281-018d5ea731f8 tempest-GroupsTest-401836109 None] Group tempest-GroupsTest-Group-1064066811: created successfully Apr 15 16:13:30 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-cf0456a9-198f-44d5-b281-018d5ea731f8 tempest-GroupsTest-401836109 None] Create group completed successfully. Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-fa532ac2-9dbc-4877-928d-76a881887521-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-fa532ac2-9dbc-4877-928d-76a881887521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-fa532ac2-9dbc-4877-928d-76a881887521" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-fa532ac2-9dbc-4877-928d-76a881887521" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Deleting offline snapshot fa532ac2-9dbc-4877-928d-76a881887521 of volume 3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] snapshot_file for this snap is: volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa56cc23-986d-4289-aa51-8b980b18b00c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:30 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 Apr 15 16:13:30 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:30 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521" returned: 0 in 0.470s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf87684-5f94-4879-9e90-dd37e23cd625]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:30 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 Apr 15 16:13:30 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:31 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" returned: 0 in 0.531s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:31 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 Apr 15 16:13:31 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Flow 'volume_create_manager' (04499e9e-a907-4c2b-8d47-91875119b254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be80685d-260e-4db5-9dd3-f27a48e74192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be80685d-260e-4db5-9dd3-f27a48e74192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1759848928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4d0b717-105e-4fe3-8d5a-dbaf61800824,host='devstack@QuobyteHD#QuobyteHD',id=3b6638eb-88b9-4e77-b754-45930e5c2663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403655ab58a348d4b47343433eab797d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:31Z,use_quota=True,user_id='29df86c4556b497bba0449cab7785af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3164a24e-6f03-4818-bf5a-f181384aef54),volume_type_id=3164a24e-6f03-4818-bf5a-f181384aef54)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acee5c03-be12-40e1-9858-f8096a33fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acee5c03-be12-40e1-9858-f8096a33fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ac2042-a425-4e44-a6eb-3575529bf755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ac2042-a425-4e44-a6eb-3575529bf755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6638eb-88b9-4e77-b754-45930e5c2663', 'volume_name': 'volume-3b6638eb-88b9-4e77-b754-45930e5c2663', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b884d38-903e-4cdb-9a8b-8a3b3a30474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b884d38-903e-4cdb-9a8b-8a3b3a30474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3185c5-d2c8-48ab-aef3-8eb4252d031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:31 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Volume 3b6638eb-88b9-4e77-b754-45930e5c2663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6638eb-88b9-4e77-b754-45930e5c2663', 'volume_size': 1} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4d0b717-105e-4fe3-8d5a-dbaf61800824,created_at=2026-04-15T14:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1759848928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4d0b717-105e-4fe3-8d5a-dbaf61800824,host='devstack@QuobyteHD#QuobyteHD',id=3b6638eb-88b9-4e77-b754-45930e5c2663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403655ab58a348d4b47343433eab797d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:31Z,use_quota=True,user_id='29df86c4556b497bba0449cab7785af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3164a24e-6f03-4818-bf5a-f181384aef54),volume_type_id=3164a24e-6f03-4818-bf5a-f181384aef54)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Creating volume 3b6638eb-88b9-4e77-b754-45930e5c2663 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:31 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:31 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 1073741824 Apr 15 16:13:31 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:31 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521" returned: 0 in 0.480s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:31 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521 Apr 15 16:13:31 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:32 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 1073741824" returned: 0 in 0.515s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:32 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 Apr 15 16:13:32 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:32 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431.fa532ac2-9dbc-4877-928d-76a881887521" returned: 0 in 0.403s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-fa532ac2-9dbc-4877-928d-76a881887521" released by "_delete_snapshot" :: held 1.941s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" released by "delete_snapshot" :: held 1.953s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Created reservations ['cd649595-e43d-411d-b3d6-ff462e738735', '6dd0e121-dad3-4f37-95d7-c2e9816ca58f', 'c21463e6-35b0-4988-9d8d-59430c64a33c', '6d897372-5a82-482f-b560-481d87e11d7f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:32 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Delete snapshot completed successfully. Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ba3eaf76-795e-468b-9686-b5054152a69c tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-fa532ac2-9dbc-4877-928d-76a881887521-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-3463b2ff-d321-4ca7-8f27-73b7ba0e0431-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-3463b2ff-d321-4ca7-8f27-73b7ba0e0431-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:32 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3185c5-d2c8-48ab-aef3-8eb4252d031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6638eb-88b9-4e77-b754-45930e5c2663', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b695254-48a9-40f9-aaaf-e8fd11bc44f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:32 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Volume volume-3b6638eb-88b9-4e77-b754-45930e5c2663 (3b6638eb-88b9-4e77-b754-45930e5c2663): created successfully Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b695254-48a9-40f9-aaaf-e8fd11bc44f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Flow 'volume_create_manager' (04499e9e-a907-4c2b-8d47-91875119b254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6954dc5-56b0-4342-ac81-cfba8f80a14e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:32 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-bdf7ab43-62a7-4b3a-a582-39fe53571388 tempest-GroupsTest-401836109 None] Created volume successfully. Apr 15 16:13:32 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 Apr 15 16:13:32 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:33 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:33 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431 Apr 15 16:13:33 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:33 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" returned: 0 in 0.400s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-3463b2ff-d321-4ca7-8f27-73b7ba0e0431" released by "delete_volume" :: held 0.883s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Created reservations ['fd26b660-6592-441a-b77c-ca8750d5f012', '7dd32768-f82c-4344-a095-983e1d4bc595', '82116904-f255-434d-b7fb-0ec108e9a2de', '996f1330-6254-461b-9d69-21de9aa5868f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:33 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:33 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Flow 'volume_create_manager' (b9ef83ee-025d-4863-bbdf-2f69d7821b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d2396e-501b-4ebb-ad5c-9c5406b072ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d2396e-501b-4ebb-ad5c-9c5406b072ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-351231432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cfbb89-024e-47be-af63-98ee6a2361c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d06e8b42764996b242df499c44f170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:34Z,use_quota=True,user_id='d1e9acc78d62409b8ea1fe5eed2151dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97172aa2-9aa9-48ec-bc91-5866cf7b6148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97172aa2-9aa9-48ec-bc91-5866cf7b6148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de4412d-14ed-4033-badc-c4cb522bcc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de4412d-14ed-4033-badc-c4cb522bcc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cfbb89-024e-47be-af63-98ee6a2361c0', 'volume_name': 'volume-c6cfbb89-024e-47be-af63-98ee6a2361c0', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fe0346-e40e-41a0-b298-bce9c45cc60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fe0346-e40e-41a0-b298-bce9c45cc60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c709bd-3796-44cd-92ee-682481e7037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:33 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Volume c6cfbb89-024e-47be-af63-98ee6a2361c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cfbb89-024e-47be-af63-98ee6a2361c0', 'volume_size': 1} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-351231432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cfbb89-024e-47be-af63-98ee6a2361c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d06e8b42764996b242df499c44f170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:34Z,use_quota=True,user_id='d1e9acc78d62409b8ea1fe5eed2151dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Creating volume c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:33 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:33 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 1073741824 Apr 15 16:13:33 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:33 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Flow 'volume_create_manager' (6bbced79-49dd-4a35-9df0-5dcc7a4eb3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694742fd-36a0-46cc-b61a-925e4c05a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694742fd-36a0-46cc-b61a-925e4c05a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1115924141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4d0b717-105e-4fe3-8d5a-dbaf61800824,host='devstack@QuobyteHD#QuobyteHD',id=1c946a53-da53-4171-a7bd-7f5147813e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403655ab58a348d4b47343433eab797d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:34Z,use_quota=True,user_id='29df86c4556b497bba0449cab7785af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3164a24e-6f03-4818-bf5a-f181384aef54),volume_type_id=3164a24e-6f03-4818-bf5a-f181384aef54)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:34 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfb1b43-d159-4a56-8262-b7412233938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfb1b43-d159-4a56-8262-b7412233938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037b80c9-0179-42b1-b3df-af0d63e3c16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037b80c9-0179-42b1-b3df-af0d63e3c16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c946a53-da53-4171-a7bd-7f5147813e20', 'volume_name': 'volume-1c946a53-da53-4171-a7bd-7f5147813e20', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec235a5-2f43-4bcf-9c4c-8bbdf0b85be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec235a5-2f43-4bcf-9c4c-8bbdf0b85be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c3773c-114c-4468-88fb-50c797336c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:34 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Volume 1c946a53-da53-4171-a7bd-7f5147813e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c946a53-da53-4171-a7bd-7f5147813e20', 'volume_size': 1} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.524s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:34 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Deleted volume successfully. Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a92a893-242d-4928-bdf8-792ce21ed5af tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-3463b2ff-d321-4ca7-8f27-73b7ba0e0431-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:34 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 1073741824" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:34 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 Apr 15 16:13:34 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:34 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0" returned: 0 in 0.413s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4d0b717-105e-4fe3-8d5a-dbaf61800824,created_at=2026-04-15T14:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1115924141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4d0b717-105e-4fe3-8d5a-dbaf61800824,host='devstack@QuobyteHD#QuobyteHD',id=1c946a53-da53-4171-a7bd-7f5147813e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403655ab58a348d4b47343433eab797d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:34Z,use_quota=True,user_id='29df86c4556b497bba0449cab7785af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3164a24e-6f03-4818-bf5a-f181384aef54),volume_type_id=3164a24e-6f03-4818-bf5a-f181384aef54)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Creating volume 1c946a53-da53-4171-a7bd-7f5147813e20 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:34 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c709bd-3796-44cd-92ee-682481e7037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cfbb89-024e-47be-af63-98ee6a2361c0', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:34 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 1073741824 Apr 15 16:13:34 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923657a9-6e3b-4470-b629-2409dbb2c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:34 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Volume volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 (c6cfbb89-024e-47be-af63-98ee6a2361c0): created successfully Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923657a9-6e3b-4470-b629-2409dbb2c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Flow 'volume_create_manager' (b9ef83ee-025d-4863-bbdf-2f69d7821b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:34 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-98794944-8e1b-4868-b16b-7dc2d9b18b07 tempest-VolumeDependencyTests-1806237498 None] Created volume successfully. Apr 15 16:13:35 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 1073741824" returned: 0 in 0.492s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:35 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 Apr 15 16:13:35 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:35 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20" returned: 0 in 0.403s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c3773c-114c-4468-88fb-50c797336c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c946a53-da53-4171-a7bd-7f5147813e20', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dd12e5-aad3-40dd-87f2-677b404ecc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:35 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Volume volume-1c946a53-da53-4171-a7bd-7f5147813e20 (1c946a53-da53-4171-a7bd-7f5147813e20): created successfully Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dd12e5-aad3-40dd-87f2-677b404ecc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Flow 'volume_create_manager' (6bbced79-49dd-4a35-9df0-5dcc7a4eb3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:35 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-54bf2c5a-9091-4973-9042-9d2caafae9b6 tempest-GroupsTest-401836109 None] Created volume successfully. Apr 15 16:13:36 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-fb379eee-6c36-43f9-9b6f-fdd52db35e53 tempest-GroupsTest-401836109 None] Update group completed successfully. Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Flow 'volume_create_manager' (bc2a7a3a-3fe1-4737-8658-8f44e2a05265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02bd9df-4ee5-43f2-90cc-0272d72fa915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02bd9df-4ee5-43f2-90cc-0272d72fa915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-812917611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbdfef8-519b-48b2-996d-c18d92db4303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d06e8b42764996b242df499c44f170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c6cfbb89-024e-47be-af63-98ee6a2361c0,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:36Z,use_quota=True,user_id='d1e9acc78d62409b8ea1fe5eed2151dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3855be05-b126-4202-8b1f-e8579c09267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3855be05-b126-4202-8b1f-e8579c09267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357979d8-9428-4301-910c-67169b78f0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357979d8-9428-4301-910c-67169b78f0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5fbdfef8-519b-48b2-996d-c18d92db4303', 'volume_name': 'volume-5fbdfef8-519b-48b2-996d-c18d92db4303', 'volume_size': 1, 'source_volid': 'c6cfbb89-024e-47be-af63-98ee6a2361c0', 'source_volstatus': 'available'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a216e73c-5450-4405-a6a2-20ce1b0ca39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a216e73c-5450-4405-a6a2-20ce1b0ca39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf00a24-36c2-43b1-b3d5-fd08bf67c999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:36 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Volume 5fbdfef8-519b-48b2-996d-c18d92db4303: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5fbdfef8-519b-48b2-996d-c18d92db4303', 'volume_size': 1, 'source_volid': 'c6cfbb89-024e-47be-af63-98ee6a2361c0', 'source_volstatus': 'available'} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:36 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Cloning volume c6cfbb89-024e-47be-af63-98ee6a2361c0 to volume 5fbdfef8-519b-48b2-996d-c18d92db4303 Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Creating offline snapshot d93df198-3cfe-4bd3-a44e-55134a71ecf9 of volume c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafdb409-fa9c-44f1-b6be-5886a89c417c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:36 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 Apr 15 16:13:36 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:36 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0" returned: 0 in 0.456s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:36 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 1G Apr 15 16:13:36 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:37 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 1G" returned: 0 in 0.535s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:37 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 Apr 15 16:13:37 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:37 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c44c9e85-cc2a-4720-a279-9e7e475e4f28 tempest-GroupsTest-401836109 None] Update group completed successfully. Apr 15 16:13:37 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9" returned: 0 in 0.430s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:37 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 is being set with open permissions: ugo+rw Apr 15 16:13:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:37 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 Apr 15 16:13:37 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:38 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9" returned: 0 in 0.414s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:38 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.info Apr 15 16:13:38 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:38 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.info" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:38 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.info is being set with open permissions: ugo+rw Apr 15 16:13:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:38 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.info Apr 15 16:13:38 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Acquiring lock "cinder-quobyte-1c946a53-da53-4171-a7bd-7f5147813e20" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:38 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Lock "cinder-quobyte-1c946a53-da53-4171-a7bd-7f5147813e20" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:38 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[49064c01-040b-45b4-8b25-027d53eef6f4]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:38 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 Apr 15 16:13:38 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:39 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.info" returned: 0 in 0.417s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-5fbdfef8-519b-48b2-996d-c18d92db4303" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-5fbdfef8-519b-48b2-996d-c18d92db4303" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] snapshot: d93df198-3cfe-4bd3-a44e-55134a71ecf9, volume: 5fbdfef8-519b-48b2-996d-c18d92db4303, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4fb1d1-0327-4ece-815c-cfc6630bcddd]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:39 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 Apr 15 16:13:39 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:39 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:39 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20 Apr 15 16:13:39 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:39 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9" returned: 0 in 0.484s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6cfbb89-024e-47be-af63-98ee6a2361c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[987984ea-4b52-4eda-aec3-8e58dc77da44]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:39 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1c946a53-da53-4171-a7bd-7f5147813e20" returned: 0 in 0.427s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Lock "cinder-quobyte-1c946a53-da53-4171-a7bd-7f5147813e20" released by "delete_volume" :: held 0.927s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Acquiring lock "cinder-quobyte-3b6638eb-88b9-4e77-b754-45930e5c2663" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Lock "cinder-quobyte-3b6638eb-88b9-4e77-b754-45930e5c2663" acquired by "delete_volume" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa724fb-bf47-4582-ba13-40d67056e959]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:39 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 Apr 15 16:13:39 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:39 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 Apr 15 16:13:39 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:40 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0" returned: 0 in 0.491s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:40 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:13:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:40 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 Apr 15 16:13:40 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:40 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663" returned: 0 in 0.471s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:40 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663 Apr 15 16:13:40 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:40 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3b6638eb-88b9-4e77-b754-45930e5c2663" returned: 0 in 0.601s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Lock "cinder-quobyte-3b6638eb-88b9-4e77-b754-45930e5c2663" released by "delete_volume" :: held 1.097s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:40 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Created reservations ['96e25b37-dabf-4f1a-a5e6-556d1e80707f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:40 devstack cinder-volume[82392]: WARNING cinder.quota [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1418623088 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1418623088, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:13:40 devstack cinder-volume[82392]: WARNING cinder.quota [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1418623088 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1418623088, it is now deprecated. Please use the default quota class for default quota. Apr 15 16:13:41 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Created reservations ['32dedc7b-3dba-490b-b94c-13798e45e562', '7add8bbb-9860-43a0-b8e5-a2d0ffd40790', '650d5528-9b36-481a-a64e-5d7645c2d00f', 'ebb2c632-f4d9-44a4-b3ce-febc558ce698'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:41 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Created reservations ['df70f0f8-2be3-4404-9193-535b9a1a7aab', '878980f8-450b-444d-b2b7-82df4ab6cb87', 'd1414ad4-7dfe-410b-a4c1-f54c7caddbe5', '2d39a52c-fb26-484b-8c79-b4d48fd4a05a'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:41 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:41 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:42 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303" returned: 0 in 2.050s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:42 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[de87d78e-e226-4a8b-bdf7-8e71daac2341]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:42 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.843s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:42 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:42 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-238a607a-e5fa-492f-861a-9220c8743e94 tempest-GroupsTest-401836109 None] Delete group completed successfully. Apr 15 16:13:42 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 Apr 15 16:13:42 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:42 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0" returned: 0 in 0.637s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:42 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:13:42 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Converted 1024.00 MB image at 499.10 MB/s Apr 15 16:13:42 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 is being set with open permissions: ugo+rw Apr 15 16:13:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:42 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 Apr 15 16:13:42 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:43 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-5fbdfef8-519b-48b2-996d-c18d92db4303" released by "_copy_volume_from_snapshot" :: held 4.192s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-d93df198-3cfe-4bd3-a44e-55134a71ecf9" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-d93df198-3cfe-4bd3-a44e-55134a71ecf9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Deleting offline snapshot d93df198-3cfe-4bd3-a44e-55134a71ecf9 of volume c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] snapshot_file for this snap is: volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638cbb6-2636-48e5-84bd-3ad98eb730e5]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:43 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 Apr 15 16:13:43 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:43 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9" returned: 0 in 0.520s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6cfbb89-024e-47be-af63-98ee6a2361c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[89940069-0f3e-46e9-a7f2-a3a4d6b3bb40]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:43 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 Apr 15 16:13:43 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:44 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0" returned: 0 in 0.486s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:44 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 Apr 15 16:13:44 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:44 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9" returned: 0 in 0.495s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:44 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9 Apr 15 16:13:44 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Flow 'volume_create_manager' (c854d939-af61-4cfb-ba12-2e2f8e23c1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d77ecc-8e55-413e-82bc-f8923036f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d77ecc-8e55-413e-82bc-f8923036f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2088968595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129a6711-95a0-407b-9ade-b94766384f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a7d5087f324707be49a4b9c2e046b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:45Z,use_quota=True,user_id='67838410591b4a0298fd1bd6e973cf69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fd85c2-0fd8-4ec7-b617-ab43333a77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fd85c2-0fd8-4ec7-b617-ab43333a77d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d918a708-2d59-4110-81e4-6bf84716e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d918a708-2d59-4110-81e4-6bf84716e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129a6711-95a0-407b-9ade-b94766384f89', 'volume_name': 'volume-129a6711-95a0-407b-9ade-b94766384f89', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc9b8f1-189f-4666-9eaf-7316d8d0121a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc9b8f1-189f-4666-9eaf-7316d8d0121a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd7fbb5-2bc5-4456-808b-77400601734c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:45 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Volume 129a6711-95a0-407b-9ade-b94766384f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129a6711-95a0-407b-9ade-b94766384f89', 'volume_size': 1} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:45 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0.d93df198-3cfe-4bd3-a44e-55134a71ecf9" returned: 0 in 0.409s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-d93df198-3cfe-4bd3-a44e-55134a71ecf9" released by "_delete_snapshot" :: held 1.965s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.965s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2088968595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129a6711-95a0-407b-9ade-b94766384f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a7d5087f324707be49a4b9c2e046b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:13:45Z,use_quota=True,user_id='67838410591b4a0298fd1bd6e973cf69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Creating volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:13:45 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf00a24-36c2-43b1-b3d5-fd08bf67c999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbdfef8-519b-48b2-996d-c18d92db4303', 'volume_size': 1, 'source_volid': 'c6cfbb89-024e-47be-af63-98ee6a2361c0', 'source_volstatus': 'available'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:45 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 1073741824 Apr 15 16:13:45 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23062578-97e0-4128-a3da-c903f1e3a658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:45 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Volume volume-5fbdfef8-519b-48b2-996d-c18d92db4303 (5fbdfef8-519b-48b2-996d-c18d92db4303): created successfully Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23062578-97e0-4128-a3da-c903f1e3a658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Flow 'volume_create_manager' (bc2a7a3a-3fe1-4737-8658-8f44e2a05265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:45 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1dc1d094-43bb-4b30-b6e3-d83025e50290 tempest-VolumeDependencyTests-1806237498 None] Created volume successfully. Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-c6cfbb89-024e-47be-af63-98ee6a2361c0-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-c6cfbb89-024e-47be-af63-98ee6a2361c0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-c6cfbb89-024e-47be-af63-98ee6a2361c0" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-c6cfbb89-024e-47be-af63-98ee6a2361c0" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:45 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 1073741824" returned: 0 in 0.515s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb867676-983d-4fa2-b940-7c5ffab96f2d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:45 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 Apr 15 16:13:45 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:45 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 Apr 15 16:13:45 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:46 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89" returned: 0 in 0.416s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd7fbb5-2bc5-4456-808b-77400601734c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129a6711-95a0-407b-9ade-b94766384f89', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258c88f1-108b-413b-9696-a16718f970e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:13:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Volume volume-129a6711-95a0-407b-9ade-b94766384f89 (129a6711-95a0-407b-9ade-b94766384f89): created successfully Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258c88f1-108b-413b-9696-a16718f970e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Flow 'volume_create_manager' (c854d939-af61-4cfb-ba12-2e2f8e23c1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:13:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-74a4dd3c-6b83-43c2-ac9b-b202d8688b85 tempest-SnapshotsActionsTest-1854666594 None] Created volume successfully. Apr 15 16:13:46 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0" returned: 0 in 0.485s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:46 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0 Apr 15 16:13:46 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:46 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c6cfbb89-024e-47be-af63-98ee6a2361c0" returned: 0 in 0.422s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-c6cfbb89-024e-47be-af63-98ee6a2361c0" released by "delete_volume" :: held 0.938s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Created reservations ['e2187d73-5e09-4177-b15d-7abe7691a958', '4886f5f6-dc2f-4fd4-a7c8-7d3382f69aee', 'e6d36ca1-e700-4f25-9306-96e089720dad', 'af84e7eb-b566-4249-8700-ac450713e114'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:46 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:46 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-5fbdfef8-519b-48b2-996d-c18d92db4303-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-5fbdfef8-519b-48b2-996d-c18d92db4303-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-5fbdfef8-519b-48b2-996d-c18d92db4303" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-5fbdfef8-519b-48b2-996d-c18d92db4303" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e856b5-069f-4c6e-8014-c1cb2e3c9e66]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:47 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 Apr 15 16:13:47 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Creating offline snapshot 3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4675e5e2-9a13-44bc-872a-f51d6784503f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:47 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.485s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:47 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Deleted volume successfully. Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-4d135aac-4668-44d9-9861-277ca156ae89 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-c6cfbb89-024e-47be-af63-98ee6a2361c0-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:47 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 Apr 15 16:13:47 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:47 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303" returned: 0 in 0.517s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:47 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303 Apr 15 16:13:47 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:47 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89" returned: 0 in 0.469s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:47 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 1G Apr 15 16:13:47 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:47 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-5fbdfef8-519b-48b2-996d-c18d92db4303" returned: 0 in 0.411s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-5fbdfef8-519b-48b2-996d-c18d92db4303" released by "delete_volume" :: held 0.951s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Created reservations ['17ceada6-fa99-4175-8b91-63a06258db99', '99e4b5ba-24e6-4aaa-99f3-9f6ab670096b', '37e0af2c-0d61-4b30-a4a4-8dfa678bcb70', '0f1bbc28-f80d-4b78-bb50-7ce2404db2fd'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:48 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:48 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-2d5d695a-e2a2-4266-90d9-dbb211a95ab6-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-2d5d695a-e2a2-4266-90d9-dbb211a95ab6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "cinder-quobyte-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f1b02-5b0b-4404-8a07-1d6431be1ed6]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:48 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 Apr 15 16:13:48 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:48 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 1G" returned: 0 in 0.577s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:48 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:13:48 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:48 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.476s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Deleted volume successfully. Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fad471dc-97a0-4854-bc82-eeec4b90ffa3 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-5fbdfef8-519b-48b2-996d-c18d92db4303-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:48 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" returned: 0 in 0.525s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:48 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6 Apr 15 16:13:48 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:48 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.442s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:48 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 is being set with open permissions: ugo+rw Apr 15 16:13:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:48 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:13:48 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:49 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" returned: 0 in 0.402s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-quobyte-2d5d695a-e2a2-4266-90d9-dbb211a95ab6" released by "delete_volume" :: held 0.950s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Created reservations ['fc132b20-2826-4cda-b953-e5df9a2ac39c', '650aefd9-92e7-4f48-9ef9-8827d48f2fe7', '8d2433c2-f80d-4520-9ddf-42400e111cdd', 'bde9ccc5-5e80-4cf4-824b-2f3049a85d0f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:49 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:13:49 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:49 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.422s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:49 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.info Apr 15 16:13:49 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:49 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.451s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:13:49 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Deleted volume successfully. Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2c6e8876-cb0a-480a-a1b5-21c2583e2ca1 tempest-VolumeDependencyTests-1806237498 None] Lock "cinder-2d5d695a-e2a2-4266-90d9-dbb211a95ab6-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:49 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.info" returned: 0 in 0.500s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:49 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.info is being set with open permissions: ugo+rw Apr 15 16:13:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:49 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.info Apr 15 16:13:49 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:50 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.info" returned: 0 in 0.439s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.910s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:50 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-4c074bac-2161-42e0-9aa0-252c8e1d88e3 tempest-SnapshotsActionsTest-1854666594 None] Create snapshot completed successfully Apr 15 16:13:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Creating offline snapshot a9d71556-25ca-408d-b7b3-ed77ce23a2a2 of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:13:50 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e31ca1-0357-4c00-80ad-ddba1f1cd32e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:50 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:13:50 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:51 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.464s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:51 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:51 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 1G Apr 15 16:13:51 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:51 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 1G" returned: 0 in 0.473s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:51 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 Apr 15 16:13:51 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:52 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2" returned: 0 in 0.431s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:52 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 is being set with open permissions: ugo+rw Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:52 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 Apr 15 16:13:52 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:52 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2" returned: 0 in 0.415s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:52 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6c82c5fd-32cd-4c4c-9902-bd194650c0a5 tempest-SnapshotsActionsTest-1854666594 None] Create snapshot completed successfully Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-a9d71556-25ca-408d-b7b3-ed77ce23a2a2-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-a9d71556-25ca-408d-b7b3-ed77ce23a2a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-quobyte-a9d71556-25ca-408d-b7b3-ed77ce23a2a2" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-a9d71556-25ca-408d-b7b3-ed77ce23a2a2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Deleting offline snapshot a9d71556-25ca-408d-b7b3-ed77ce23a2a2 of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] snapshot_file for this snap is: volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dd4475-c8fa-4834-ad77-54c4cdcc99e8]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:53 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 Apr 15 16:13:53 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:53 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2" returned: 0 in 0.459s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a5fdc5-e8f5-4061-ae0c-78af37ab2778]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:53 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:13:53 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:53 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:53 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 Apr 15 16:13:53 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:54 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:54 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2 Apr 15 16:13:54 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:54 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.a9d71556-25ca-408d-b7b3-ed77ce23a2a2" returned: 0 in 0.395s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-a9d71556-25ca-408d-b7b3-ed77ce23a2a2" released by "_delete_snapshot" :: held 1.815s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" released by "delete_snapshot" :: held 1.826s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:54 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Created reservations ['cf3c1e74-d2e0-439f-b767-d420aaa87861', 'cbe37c91-6cd6-4459-8b53-f3b36f50c637', 'd56cb1d4-6978-4c38-a068-3e68569154f6', '55d95e24-52a4-4783-a5c0-0520ea229c65'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:54 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Delete snapshot completed successfully. Apr 15 16:13:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8fc025dd-774c-4c71-93c0-dbabb6d9cc11 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-a9d71556-25ca-408d-b7b3-ed77ce23a2a2-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Creating offline snapshot 01bf8017-543c-42f7-bf4c-50b9b1e86109 of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:13:55 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fda56e-6f54-42b7-933c-c230ab7a0d6b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:55 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:13:55 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:55 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.460s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:55 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 1G Apr 15 16:13:55 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:56 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 1G" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:56 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 Apr 15 16:13:56 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:56 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109" returned: 0 in 0.425s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:56 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 is being set with open permissions: ugo+rw Apr 15 16:13:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:56 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 Apr 15 16:13:56 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:56 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109" returned: 0 in 0.399s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:13:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f2763a30-3761-49e3-a3b4-0f3a57caa1be tempest-SnapshotsActionsTest-1854666594 None] Create snapshot completed successfully Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-01bf8017-543c-42f7-bf4c-50b9b1e86109-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-01bf8017-543c-42f7-bf4c-50b9b1e86109-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-quobyte-01bf8017-543c-42f7-bf4c-50b9b1e86109" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-01bf8017-543c-42f7-bf4c-50b9b1e86109" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Deleting offline snapshot 01bf8017-543c-42f7-bf4c-50b9b1e86109 of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] snapshot_file for this snap is: volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4020af07-d9c5-4aa6-82d0-38c8bf2a3d73]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:57 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 Apr 15 16:13:57 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:58 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109" returned: 0 in 0.478s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d538aad-0cb3-4511-896a-9d39f89fcff4]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:58 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:13:58 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:58 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:58 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 Apr 15 16:13:58 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:58 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109" returned: 0 in 0.451s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:59 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109 Apr 15 16:13:59 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:13:59 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.01bf8017-543c-42f7-bf4c-50b9b1e86109" returned: 0 in 0.402s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-01bf8017-543c-42f7-bf4c-50b9b1e86109" released by "_delete_snapshot" :: held 1.846s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" released by "delete_snapshot" :: held 1.860s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Created reservations ['67614749-44df-4152-8932-d575828d87ab', '1e74229d-965f-4eee-b9b6-ceff32631222', 'f093347b-0b2a-4aaf-946e-3a352b2ef552', '18318a63-f7eb-42cc-9aec-ae60520aea21'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:13:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Delete snapshot completed successfully. Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-26bf9569-27c2-453f-b51f-f8fa1239670e tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-01bf8017-543c-42f7-bf4c-50b9b1e86109-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Creating offline snapshot 9b2e85e8-13b0-4686-9211-edb703c281cb of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c604aa7f-57ca-4fff-ada9-00c89e98d4b7]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:13:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:13:59 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:13:59 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:00 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:14:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:00 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb 1G Apr 15 16:14:00 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:00 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb 1G" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:00 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb Apr 15 16:14:00 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:01 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb" returned: 0 in 0.422s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:01 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb is being set with open permissions: ugo+rw Apr 15 16:14:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:01 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb Apr 15 16:14:01 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:01 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb" returned: 0 in 0.398s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1efd7d74-da53-474b-941c-5d1d39947595 tempest-SnapshotsActionsTest-1854666594 None] Create snapshot completed successfully Apr 15 16:14:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-9b2e85e8-13b0-4686-9211-edb703c281cb-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-9b2e85e8-13b0-4686-9211-edb703c281cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-quobyte-9b2e85e8-13b0-4686-9211-edb703c281cb" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-9b2e85e8-13b0-4686-9211-edb703c281cb" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Deleting offline snapshot 9b2e85e8-13b0-4686-9211-edb703c281cb of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] snapshot_file for this snap is: volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dae69d-8cf0-4e6b-ad63-13456d8da165]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:02 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb Apr 15 16:14:02 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:02 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb" returned: 0 in 0.468s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[49907154-62fa-4266-8d2a-a47e7023c48f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:02 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:14:02 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:02 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.451s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:14:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:03 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb Apr 15 16:14:03 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:03 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb" returned: 0 in 0.475s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:03 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb Apr 15 16:14:03 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:03 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.9b2e85e8-13b0-4686-9211-edb703c281cb" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-9b2e85e8-13b0-4686-9211-edb703c281cb" released by "_delete_snapshot" :: held 1.837s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" released by "delete_snapshot" :: held 1.851s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Created reservations ['f6f25712-2948-4a56-ad6b-29437e6ae934', '1d2ff2ae-e248-42e0-8052-42d5dcfa3bf6', '4de198e1-4dce-4db5-b68d-2e7c1c4c8484', '0fb015f7-61ce-42a8-a0ff-67d2cf7a8c75'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:03 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Delete snapshot completed successfully. Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-94aa6d80-862a-467d-ad19-aaacf8a0aeb0 tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-9b2e85e8-13b0-4686-9211-edb703c281cb-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:03 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:03 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Creating offline snapshot 920a3fc6-161b-492c-aba7-49cfb2186a27 of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7165bcb-9163-47c9-b61d-e49075eba8e8]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:04 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:14:04 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:04 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.448s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:04 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:14:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:04 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 1G Apr 15 16:14:04 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:05 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 1G" returned: 0 in 0.471s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:05 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 Apr 15 16:14:05 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:05 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27" returned: 0 in 0.414s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:05 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 is being set with open permissions: ugo+rw Apr 15 16:14:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:05 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 Apr 15 16:14:05 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:06 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27" returned: 0 in 0.385s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.776s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:06 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-4285c53f-e3d3-4f26-a1a2-3264ed29413d tempest-SnapshotsActionsTest-1854666594 None] Create snapshot completed successfully Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-920a3fc6-161b-492c-aba7-49cfb2186a27-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-920a3fc6-161b-492c-aba7-49cfb2186a27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Acquiring lock "cinder-quobyte-920a3fc6-161b-492c-aba7-49cfb2186a27" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-920a3fc6-161b-492c-aba7-49cfb2186a27" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Deleting offline snapshot 920a3fc6-161b-492c-aba7-49cfb2186a27 of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] snapshot_file for this snap is: volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1954b8be-7709-47db-b518-98cb1f131071]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:06 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 Apr 15 16:14:06 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:06 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7008b570-e79a-45d8-b4c8-aa66115664a3]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:07 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:14:07 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:07 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.449s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:14:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:07 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 Apr 15 16:14:07 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:07 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:07 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27 Apr 15 16:14:07 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:08 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.920a3fc6-161b-492c-aba7-49cfb2186a27" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-920a3fc6-161b-492c-aba7-49cfb2186a27" released by "_delete_snapshot" :: held 1.816s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" released by "delete_snapshot" :: held 1.830s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:UPDATE=181,cinder:SELECT=176,cinder:INSERT=48,cinder:DELETE=13 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=158,cinder:UPDATE=207,cinder:INSERT=48,cinder:DELETE=11 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Created reservations ['19185307-439b-4de5-a983-15ee73bb4572', '0002df93-4b29-4091-8c73-31addaea00b7', 'c28fa7cb-fe86-4d13-b219-9275f28e98ad', '6f976901-62fd-4a97-a65a-77f8fb9ba55c'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:08 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Delete snapshot completed successfully. Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f4f5b4bc-2d19-4899-b29c-fe2ea825662b tempest-SnapshotsActionsTest-1001366937 None] Lock "cinder-920a3fc6-161b-492c-aba7-49cfb2186a27-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "cinder-3ad3997d-d8d4-4895-aecb-0947dfdaa6a8-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-3ad3997d-d8d4-4895-aecb-0947dfdaa6a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "cinder-quobyte-3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-quobyte-3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Deleting offline snapshot 3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 of volume 129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] snapshot_file for this snap is: volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ddf77f-c907-45cc-8396-03d6f0f34590]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:08 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:14:08 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:09 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a6711-95a0-407b-9ade-b94766384f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:14:09 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15109b0-18bf-478b-90a3-f3748db27489]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:09 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 Apr 15 16:14:09 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:09 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:09 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:14:09 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:10 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.449s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:10 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8 Apr 15 16:14:10 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:10 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89.3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" returned: 0 in 0.395s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-quobyte-3ad3997d-d8d4-4895-aecb-0947dfdaa6a8" released by "_delete_snapshot" :: held 1.808s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" released by "delete_snapshot" :: held 1.823s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Created reservations ['e6b9c7a8-3e7a-4d75-a23a-35bdea6fa7b7', '9b1472bc-ae89-4a35-88cc-f27fe9ee460a', 'df072653-23b7-4906-81e4-7a6353c80756', 'eafee5e5-180f-45e9-a5b7-d3c9fe21cc16'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Delete snapshot completed successfully. Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1d7cb8a4-4505-4604-84d3-d60eacb13b16 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-3ad3997d-d8d4-4895-aecb-0947dfdaa6a8-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "cinder-129a6711-95a0-407b-9ade-b94766384f89-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-129a6711-95a0-407b-9ade-b94766384f89-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[097acce4-dda3-42b8-bbf3-850c3ef97899]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:11 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 Apr 15 16:14:11 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:11 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89" returned: 0 in 0.464s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:11 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89 Apr 15 16:14:11 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:11 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-129a6711-95a0-407b-9ade-b94766384f89" returned: 0 in 0.406s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-quobyte-129a6711-95a0-407b-9ade-b94766384f89" released by "delete_volume" :: held 0.911s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Created reservations ['fbb0b677-9a7a-4d66-aa5b-99c97c20fa33', '3808f8c7-ee50-4182-9875-1aceac2fc5a4', '42170e9f-94e1-4b00-a9da-b0e604b26dee', '70bd27b9-c23b-4a54-ab93-4ac70d8087c8'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:12 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:12 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:12 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.448s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:12 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:12 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Deleted volume successfully. Apr 15 16:14:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-97e7deab-4437-4126-b55b-80e1a1d1e556 tempest-SnapshotsActionsTest-1854666594 None] Lock "cinder-129a6711-95a0-407b-9ade-b94766384f89-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Flow 'volume_create_manager' (9d715381-7a99-42c7-aa2c-1325657ea1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf17fb03-f426-4dff-8edc-b342201c90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf17fb03-f426-4dff-8edc-b342201c90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-909939482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc88cd-bead-4030-ae22-89931c560b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7fc8de0dd7493d9a0fc687f0a34dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:15Z,use_quota=True,user_id='30fa5637f019432eb88bbd2e56d19ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07396608-4357-4c44-8872-b2e24dbf22d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07396608-4357-4c44-8872-b2e24dbf22d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1555de-adca-4a41-ba30-829b1f4199dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1555de-adca-4a41-ba30-829b1f4199dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dc88cd-bead-4030-ae22-89931c560b8a', 'volume_name': 'volume-e0dc88cd-bead-4030-ae22-89931c560b8a', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7bcfd5e-b122-43e4-926d-caf76261bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7bcfd5e-b122-43e4-926d-caf76261bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7706aeb-69c0-4e5b-85e6-b7b93f4ff89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:14 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Volume e0dc88cd-bead-4030-ae22-89931c560b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dc88cd-bead-4030-ae22-89931c560b8a', 'volume_size': 1} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-909939482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc88cd-bead-4030-ae22-89931c560b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7fc8de0dd7493d9a0fc687f0a34dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:15Z,use_quota=True,user_id='30fa5637f019432eb88bbd2e56d19ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Creating volume e0dc88cd-bead-4030-ae22-89931c560b8a {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:14:14 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:14:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:14 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a 1073741824 Apr 15 16:14:14 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:15 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a 1073741824" returned: 0 in 0.473s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:15 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a Apr 15 16:14:15 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:15 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a" returned: 0 in 0.394s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7706aeb-69c0-4e5b-85e6-b7b93f4ff89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dc88cd-bead-4030-ae22-89931c560b8a', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a290a4-ef1f-4bf3-9190-b7a44be3317d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:15 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Volume volume-e0dc88cd-bead-4030-ae22-89931c560b8a (e0dc88cd-bead-4030-ae22-89931c560b8a): created successfully Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a290a4-ef1f-4bf3-9190-b7a44be3317d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Flow 'volume_create_manager' (9d715381-7a99-42c7-aa2c-1325657ea1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:15 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-91b55f26-7889-4d30-8051-7d6c56ecbfd2 tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Created volume successfully. Apr 15 16:14:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Acquiring lock "cinder-e0dc88cd-bead-4030-ae22-89931c560b8a-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "cinder-e0dc88cd-bead-4030-ae22-89931c560b8a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Acquiring lock "cinder-quobyte-e0dc88cd-bead-4030-ae22-89931c560b8a" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "cinder-quobyte-e0dc88cd-bead-4030-ae22-89931c560b8a" acquired by "delete_volume" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:16 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[194518da-f2b5-43da-aff6-18c573d8811d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:16 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a Apr 15 16:14:16 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:16 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a" returned: 0 in 0.474s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:17 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a Apr 15 16:14:17 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:17 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e0dc88cd-bead-4030-ae22-89931c560b8a" returned: 0 in 0.393s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "cinder-quobyte-e0dc88cd-bead-4030-ae22-89931c560b8a" released by "delete_volume" :: held 0.895s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Created reservations ['7363f1ad-3a00-4cb0-a008-eaa2551cf0c4', '6725478f-c4cd-4f04-bb23-0b0e6dd8cb34', '2a7ca1e9-6d14-442a-a2c4-bb2255301a8b', '418090a2-4991-46b8-9c45-b85d86fe4877'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:17 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:17 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:17 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.469s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:17 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Deleted volume successfully. Apr 15 16:14:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-25567554-dd1c-4c6d-87ba-ff316ed1561a tempest-VolumeQuotasNegativeTestJSON-1180306440 None] Lock "cinder-e0dc88cd-bead-4030-ae22-89931c560b8a-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Flow 'volume_create_manager' (c0850c66-4de3-4b87-80f8-7bfae1da2c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a710ef49-3b4f-4698-a323-0e11f05e3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a710ef49-3b4f-4698-a323-0e11f05e3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-108786949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9880481a-c409-44c2-abb4-b023260c9f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1836a39fa770481aa0638a659cc28805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:20Z,use_quota=True,user_id='490abfa23a7e4adc9bda314edda8f42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f686a745-9a64-4584-aa9a-bc2ae68bb338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f686a745-9a64-4584-aa9a-bc2ae68bb338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045eafad-488c-46fc-8770-55d2f7d08adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045eafad-488c-46fc-8770-55d2f7d08adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9880481a-c409-44c2-abb4-b023260c9f71', 'volume_name': 'volume-9880481a-c409-44c2-abb4-b023260c9f71', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e0c131-dcb0-4d45-aa1f-8b49d3eaaf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e0c131-dcb0-4d45-aa1f-8b49d3eaaf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a78153-e516-4cbc-ae06-8b7d41afb2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:20 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Volume 9880481a-c409-44c2-abb4-b023260c9f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9880481a-c409-44c2-abb4-b023260c9f71', 'volume_size': 1} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-108786949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9880481a-c409-44c2-abb4-b023260c9f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1836a39fa770481aa0638a659cc28805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:20Z,use_quota=True,user_id='490abfa23a7e4adc9bda314edda8f42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Creating volume 9880481a-c409-44c2-abb4-b023260c9f71 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:14:20 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:20 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 1073741824 Apr 15 16:14:20 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:20 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 1073741824" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:20 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 Apr 15 16:14:20 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:21 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a78153-e516-4cbc-ae06-8b7d41afb2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9880481a-c409-44c2-abb4-b023260c9f71', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b44f95d-c788-46b2-9f38-567c5c5f2e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:21 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Volume volume-9880481a-c409-44c2-abb4-b023260c9f71 (9880481a-c409-44c2-abb4-b023260c9f71): created successfully Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b44f95d-c788-46b2-9f38-567c5c5f2e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Flow 'volume_create_manager' (c0850c66-4de3-4b87-80f8-7bfae1da2c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:21 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-a1b3af60-67f6-4ad5-ab7c-45360962321f tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Created volume successfully. Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Creating offline snapshot 9dfd1663-69d9-4e22-b694-3b9d9168ee18 of volume 9880481a-c409-44c2-abb4-b023260c9f71 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d0228c-844a-4f21-979d-9cc424e14197]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:21 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 Apr 15 16:14:21 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:22 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71" returned: 0 in 0.473s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:22 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 1G Apr 15 16:14:22 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:22 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 1G" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9880481a-c409-44c2-abb4-b023260c9f71 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:22 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9880481a-c409-44c2-abb4-b023260c9f71 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 Apr 15 16:14:22 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:22 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9880481a-c409-44c2-abb4-b023260c9f71 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18" returned: 0 in 0.422s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:22 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 is being set with open permissions: ugo+rw Apr 15 16:14:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:22 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 Apr 15 16:14:22 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:23 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:23 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.info Apr 15 16:14:23 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:23 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.info" returned: 0 in 0.404s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:23 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.info is being set with open permissions: ugo+rw Apr 15 16:14:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:23 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.info Apr 15 16:14:23 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:24 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.info" returned: 0 in 0.406s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:24 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-de472a63-accc-4b68-8ff6-fb8bebe71665 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Create snapshot completed successfully Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "cinder-9dfd1663-69d9-4e22-b694-3b9d9168ee18-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-9dfd1663-69d9-4e22-b694-3b9d9168ee18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "cinder-quobyte-9880481a-c409-44c2-abb4-b023260c9f71" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-quobyte-9880481a-c409-44c2-abb4-b023260c9f71" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "cinder-quobyte-9dfd1663-69d9-4e22-b694-3b9d9168ee18" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-quobyte-9dfd1663-69d9-4e22-b694-3b9d9168ee18" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Deleting offline snapshot 9dfd1663-69d9-4e22-b694-3b9d9168ee18 of volume 9880481a-c409-44c2-abb4-b023260c9f71 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] snapshot_file for this snap is: volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d134f4-1d24-4265-8656-3444bb831640]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:25 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 Apr 15 16:14:25 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:25 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9880481a-c409-44c2-abb4-b023260c9f71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1febb8aa-19ba-4936-ac99-dd1de8dd532b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:25 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 Apr 15 16:14:25 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:25 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:25 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 Apr 15 16:14:25 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:26 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18" returned: 0 in 0.443s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:26 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18 Apr 15 16:14:26 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:26 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71.9dfd1663-69d9-4e22-b694-3b9d9168ee18" returned: 0 in 0.414s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-quobyte-9dfd1663-69d9-4e22-b694-3b9d9168ee18" released by "_delete_snapshot" :: held 1.845s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-quobyte-9880481a-c409-44c2-abb4-b023260c9f71" released by "delete_snapshot" :: held 1.858s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:26 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Created reservations ['d51439fd-ba95-4457-bec3-b85d8b8c9c95', '644e2660-c51c-4a84-9223-b970dc381396', '04c9800e-0962-4af8-9b75-00d06c5564bf', '90894733-ab05-47b9-a19b-16ed0631d332'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:26 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Delete snapshot completed successfully. Apr 15 16:14:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-62dec469-f144-429a-980f-5b5b25ddf7bc tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-9dfd1663-69d9-4e22-b694-3b9d9168ee18-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "cinder-9880481a-c409-44c2-abb4-b023260c9f71-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-9880481a-c409-44c2-abb4-b023260c9f71-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "cinder-quobyte-9880481a-c409-44c2-abb4-b023260c9f71" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-quobyte-9880481a-c409-44c2-abb4-b023260c9f71" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:27 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c692b5df-3faf-4091-9485-9f4f1392f285]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:27 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 Apr 15 16:14:27 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:27 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71" returned: 0 in 0.469s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:27 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71 Apr 15 16:14:27 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:28 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9880481a-c409-44c2-abb4-b023260c9f71" returned: 0 in 0.407s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-quobyte-9880481a-c409-44c2-abb4-b023260c9f71" released by "delete_volume" :: held 0.908s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Created reservations ['3c4ced46-d5fe-40aa-94e5-3c95c6f274a3', '5e8e64c7-9457-43e0-bd74-12d879db4ea4', '68cf21d1-b0d9-40ff-8164-02dfab5d9d4c', '17c7885a-efef-4199-8bd7-ee51d7ed2652'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:28 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:28 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:28 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.428s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:28 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Deleted volume successfully. Apr 15 16:14:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1bb34a23-dd91-47dc-80ff-9923a62e0d85 tempest-VolumeSnapshotQuotasNegativeTestJSON-178466306 None] Lock "cinder-9880481a-c409-44c2-abb4-b023260c9f71-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Flow 'volume_create_manager' (cfc6e985-97bd-423a-8c10-c1107ee92b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37423815-5760-41ad-bbde-7adf11c57d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37423815-5760-41ad-bbde-7adf11c57d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2061062653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c53066-4b63-40dc-86fe-2b75b6affec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc03cbef380742b4bee28c854422a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:31Z,use_quota=True,user_id='5cd1fdd8bf8e4d2893313abe41c9bb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b7411a-2c54-4abe-8e3e-c97817f4f36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b7411a-2c54-4abe-8e3e-c97817f4f36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5ce28b-2ae3-44a6-adae-8f8afdeb0d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5ce28b-2ae3-44a6-adae-8f8afdeb0d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c53066-4b63-40dc-86fe-2b75b6affec0', 'volume_name': 'volume-01c53066-4b63-40dc-86fe-2b75b6affec0', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703bc5a9-cd67-4913-b8b7-f7525b780245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703bc5a9-cd67-4913-b8b7-f7525b780245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b0be47-dc38-4f10-a2b0-3206b12f56a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:30 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Volume 01c53066-4b63-40dc-86fe-2b75b6affec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c53066-4b63-40dc-86fe-2b75b6affec0', 'volume_size': 1} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2061062653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c53066-4b63-40dc-86fe-2b75b6affec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc03cbef380742b4bee28c854422a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:31Z,use_quota=True,user_id='5cd1fdd8bf8e4d2893313abe41c9bb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Creating volume 01c53066-4b63-40dc-86fe-2b75b6affec0 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:14:31 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:31 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 1073741824 Apr 15 16:14:31 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:31 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 1073741824" returned: 0 in 0.482s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:31 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 Apr 15 16:14:31 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:31 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b0be47-dc38-4f10-a2b0-3206b12f56a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c53066-4b63-40dc-86fe-2b75b6affec0', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ad3a42-ae21-4fdb-9b0b-7ae08a745448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:31 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Volume volume-01c53066-4b63-40dc-86fe-2b75b6affec0 (01c53066-4b63-40dc-86fe-2b75b6affec0): created successfully Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ad3a42-ae21-4fdb-9b0b-7ae08a745448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Flow 'volume_create_manager' (cfc6e985-97bd-423a-8c10-c1107ee92b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:31 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-23c235b0-84d8-48e0-8358-846685daab57 tempest-VolumesListAdminTestJSON-2066826172 None] Created volume successfully. Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Flow 'volume_create_manager' (5ca410ff-1452-4746-9237-3bbb57c51bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179aceb5-b2a5-4519-acfb-e8d357629330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179aceb5-b2a5-4519-acfb-e8d357629330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2080412204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aded7cc6-7db3-4310-9d0e-693846a8ddb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc03cbef380742b4bee28c854422a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:33Z,use_quota=True,user_id='5cd1fdd8bf8e4d2893313abe41c9bb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbd757c-9178-4d67-b836-ad7a55ce4857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbd757c-9178-4d67-b836-ad7a55ce4857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0fddd-b3dd-4044-98b8-baf033f5b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0fddd-b3dd-4044-98b8-baf033f5b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aded7cc6-7db3-4310-9d0e-693846a8ddb9', 'volume_name': 'volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cccfb04-e579-4504-8139-d1e33c0020fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cccfb04-e579-4504-8139-d1e33c0020fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372e1f18-76b8-4f2d-920e-a157d2eb667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:33 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Volume aded7cc6-7db3-4310-9d0e-693846a8ddb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9', 'volume_size': 1} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2080412204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aded7cc6-7db3-4310-9d0e-693846a8ddb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc03cbef380742b4bee28c854422a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:33Z,use_quota=True,user_id='5cd1fdd8bf8e4d2893313abe41c9bb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Creating volume aded7cc6-7db3-4310-9d0e-693846a8ddb9 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:14:33 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:33 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 1073741824 Apr 15 16:14:33 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:33 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 1073741824" returned: 0 in 0.491s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:33 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 Apr 15 16:14:33 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:34 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9" returned: 0 in 0.403s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:14:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372e1f18-76b8-4f2d-920e-a157d2eb667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae7ffea-a6dc-4d66-b41a-4af6f1e68591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:34 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Volume volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 (aded7cc6-7db3-4310-9d0e-693846a8ddb9): created successfully Apr 15 16:14:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae7ffea-a6dc-4d66-b41a-4af6f1e68591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Flow 'volume_create_manager' (5ca410ff-1452-4746-9237-3bbb57c51bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:34 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-13ade115-e3d6-46eb-b9f0-6611edc3de50 tempest-VolumesListAdminTestJSON-2066826172 None] Created volume successfully. Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Flow 'volume_create_manager' (f1731f13-ea23-45cb-88f5-325e412dd67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072a43c8-b3d7-4c32-92d2-328f54014a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072a43c8-b3d7-4c32-92d2-328f54014a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-968983234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe15d623-5572-400d-9d5c-3249e86b231b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc03cbef380742b4bee28c854422a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:36Z,use_quota=True,user_id='5cd1fdd8bf8e4d2893313abe41c9bb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc644d48-7ec6-4c66-871d-9cba68ef7210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc644d48-7ec6-4c66-871d-9cba68ef7210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b2e455-c42e-42c8-98a4-0d9f1a5376b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b2e455-c42e-42c8-98a4-0d9f1a5376b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe15d623-5572-400d-9d5c-3249e86b231b', 'volume_name': 'volume-fe15d623-5572-400d-9d5c-3249e86b231b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc797e9-883a-4757-acee-046987255e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc797e9-883a-4757-acee-046987255e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3118ff-28ce-4a23-9ea4-5fdd927c1d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:35 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Volume fe15d623-5572-400d-9d5c-3249e86b231b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe15d623-5572-400d-9d5c-3249e86b231b', 'volume_size': 1} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-968983234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe15d623-5572-400d-9d5c-3249e86b231b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc03cbef380742b4bee28c854422a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:36Z,use_quota=True,user_id='5cd1fdd8bf8e4d2893313abe41c9bb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Creating volume fe15d623-5572-400d-9d5c-3249e86b231b {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:14:35 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:14:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:35 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b 1073741824 Apr 15 16:14:35 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:36 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b 1073741824" returned: 0 in 0.505s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:36 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b Apr 15 16:14:36 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:36 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3118ff-28ce-4a23-9ea4-5fdd927c1d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe15d623-5572-400d-9d5c-3249e86b231b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8320b921-bcfe-49f3-9429-7c1940aea627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:36 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Volume volume-fe15d623-5572-400d-9d5c-3249e86b231b (fe15d623-5572-400d-9d5c-3249e86b231b): created successfully Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8320b921-bcfe-49f3-9429-7c1940aea627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Flow 'volume_create_manager' (f1731f13-ea23-45cb-88f5-325e412dd67e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:36 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ea12b562-1407-4daa-b8fe-390fe9c39b24 tempest-VolumesListAdminTestJSON-2066826172 None] Created volume successfully. Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Flow 'volume_create_manager' (518fddc0-ea3f-4787-b865-998136929064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d33151-db7f-46e6-b711-c1940f0e38aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d33151-db7f-46e6-b711-c1940f0e38aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53eb139-165f-494d-8e39-8229d5706753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40158dd8b5884384b99e3723e1042a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:38Z,use_quota=True,user_id='2ac8e7cb1d534a7ea1172a21662b57ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ca1ac7-0678-426f-bcbb-9170d8737b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ca1ac7-0678-426f-bcbb-9170d8737b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e963729e-a63a-4831-b51e-0f1fbed13555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e963729e-a63a-4831-b51e-0f1fbed13555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd53eb139-165f-494d-8e39-8229d5706753', 'volume_name': 'volume-d53eb139-165f-494d-8e39-8229d5706753', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d50a3ae-f6ba-4da2-9fd3-eafdf42a24cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d50a3ae-f6ba-4da2-9fd3-eafdf42a24cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52f8d19-28f8-4502-a012-164cba002f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:38 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Volume d53eb139-165f-494d-8e39-8229d5706753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d53eb139-165f-494d-8e39-8229d5706753', 'volume_size': 1} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53eb139-165f-494d-8e39-8229d5706753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40158dd8b5884384b99e3723e1042a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:38Z,use_quota=True,user_id='2ac8e7cb1d534a7ea1172a21662b57ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Creating volume d53eb139-165f-494d-8e39-8229d5706753 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:14:38 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:38 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 1073741824 Apr 15 16:14:38 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:38 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 1073741824" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:38 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 Apr 15 16:14:38 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:39 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753" returned: 0 in 0.402s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:14:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52f8d19-28f8-4502-a012-164cba002f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53eb139-165f-494d-8e39-8229d5706753', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96011a-e80f-4f84-a1c0-fbf42c8f4843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:39 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Volume volume-d53eb139-165f-494d-8e39-8229d5706753 (d53eb139-165f-494d-8e39-8229d5706753): created successfully Apr 15 16:14:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96011a-e80f-4f84-a1c0-fbf42c8f4843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Flow 'volume_create_manager' (518fddc0-ea3f-4787-b865-998136929064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:39 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-857146ad-2572-4c65-95d9-138d87dd8e65 tempest-VolumesListAdminTestJSON-108606005 None] Created volume successfully. Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Acquiring lock "cinder-d53eb139-165f-494d-8e39-8229d5706753-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Lock "cinder-d53eb139-165f-494d-8e39-8229d5706753-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Acquiring lock "cinder-quobyte-d53eb139-165f-494d-8e39-8229d5706753" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Lock "cinder-quobyte-d53eb139-165f-494d-8e39-8229d5706753" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[20146079-f204-47c5-8ab9-cea89edc62b5]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "cinder-fe15d623-5572-400d-9d5c-3249e86b231b-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-fe15d623-5572-400d-9d5c-3249e86b231b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "cinder-quobyte-fe15d623-5572-400d-9d5c-3249e86b231b" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-quobyte-fe15d623-5572-400d-9d5c-3249e86b231b" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:40 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 Apr 15 16:14:40 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f063ce8e-22d3-4ec8-a15c-7bea2102628d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:40 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b Apr 15 16:14:40 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:40 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753" returned: 0 in 0.491s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:40 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753 Apr 15 16:14:40 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:40 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b" returned: 0 in 0.481s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:40 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b Apr 15 16:14:40 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:41 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d53eb139-165f-494d-8e39-8229d5706753" returned: 0 in 0.413s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Lock "cinder-quobyte-d53eb139-165f-494d-8e39-8229d5706753" released by "delete_volume" :: held 0.928s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Created reservations ['82e29c74-b4a3-40d9-bd70-75602b53a900', 'c772c4ed-fc00-4fdc-9af2-ac2f3fd82b03', 'f8717bfc-bbd4-4fd1-9c8d-774e7c2578e9', '91678579-438d-4549-8f47-fab7afe77162'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:41 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fe15d623-5572-400d-9d5c-3249e86b231b" returned: 0 in 0.430s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-quobyte-fe15d623-5572-400d-9d5c-3249e86b231b" released by "delete_volume" :: held 0.938s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:41 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:41 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Created reservations ['ba0555a0-1edf-4399-b7cd-068c80773bfd', 'efa8f3dd-a00e-4959-8dbd-bbe04589ef93', 'ce89e9d4-d7ce-45ca-963a-3af970aea0ab', 'f5633cd0-537d-4cb7-919c-f03e56c0b6eb'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:41 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:41 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "cinder-aded7cc6-7db3-4310-9d0e-693846a8ddb9-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-aded7cc6-7db3-4310-9d0e-693846a8ddb9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "cinder-quobyte-aded7cc6-7db3-4310-9d0e-693846a8ddb9" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-quobyte-aded7cc6-7db3-4310-9d0e-693846a8ddb9" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dee165-c23b-4bd0-b1da-0679d560a3e6]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:41 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 Apr 15 16:14:41 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:41 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.451s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Deleted volume successfully. Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-89f87645-5f38-4cf1-b639-178da21af644 tempest-VolumesListAdminTestJSON-108606005 None] Lock "cinder-d53eb139-165f-494d-8e39-8229d5706753-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:41 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Deleted volume successfully. Apr 15 16:14:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-8e15de29-542d-4a61-a556-1b3c5baf1637 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-fe15d623-5572-400d-9d5c-3249e86b231b-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:42 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:42 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9 Apr 15 16:14:42 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:42 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aded7cc6-7db3-4310-9d0e-693846a8ddb9" returned: 0 in 0.402s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-quobyte-aded7cc6-7db3-4310-9d0e-693846a8ddb9" released by "delete_volume" :: held 0.908s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Created reservations ['fbe68438-8952-4441-9e84-3eb93d686aaf', 'c2a6c72a-be73-4e7c-b218-30b2ef5a5c3c', '452e640c-2282-472f-ba56-3dac65d0737a', 'a01d01d8-4b3e-40e9-bf20-8f198024b49a'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:42 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:42 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "cinder-01c53066-4b63-40dc-86fe-2b75b6affec0-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-01c53066-4b63-40dc-86fe-2b75b6affec0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "cinder-quobyte-01c53066-4b63-40dc-86fe-2b75b6affec0" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-quobyte-01c53066-4b63-40dc-86fe-2b75b6affec0" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de4053-f771-41fd-924e-6e33b452984e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:42 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 Apr 15 16:14:42 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:43 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.498s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:43 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Deleted volume successfully. Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e1b4a016-7438-4c9d-96ad-13f418edd923 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-aded7cc6-7db3-4310-9d0e-693846a8ddb9-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:43 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0" returned: 0 in 0.476s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:43 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0 Apr 15 16:14:43 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:43 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01c53066-4b63-40dc-86fe-2b75b6affec0" returned: 0 in 0.402s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-quobyte-01c53066-4b63-40dc-86fe-2b75b6affec0" released by "delete_volume" :: held 0.901s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Created reservations ['9ae2b332-6660-43e6-96b2-b2b33123d5fa', '56e42399-6767-48d6-b95e-a82b1bd468e2', '99b60e77-fcff-4906-81a3-8c1a579e9d16', '75612f68-9c17-4c63-935e-72ef30ccdccf'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:43 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:43 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:44 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.440s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:44 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:44 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Deleted volume successfully. Apr 15 16:14:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1dd11076-f7f6-4a6f-be43-3ca2324138e6 tempest-VolumesListAdminTestJSON-2066826172 None] Lock "cinder-01c53066-4b63-40dc-86fe-2b75b6affec0-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Flow 'volume_create_manager' (30b1949f-c196-4b3b-8d48-cb4fdba14c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9706f658-de76-4794-aa32-e511c5758298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9706f658-de76-4794-aa32-e511c5758298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-297833281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6376a2-463b-4266-a9d8-471e773229eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97aabb198ff54bf6bd2e11fbca792aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:46Z,use_quota=True,user_id='11603785bdaa4fc0b71d812a3193a938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2555ff-6721-4fa6-9388-ab7816fda2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2555ff-6721-4fa6-9388-ab7816fda2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9146dd1-f202-4d3e-b165-0343ece1abe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.image.glance [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Creating Keystone auth plugin from conf {{(pid=82392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9146dd1-f202-4d3e-b165-0343ece1abe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a6376a2-463b-4266-a9d8-471e773229eb', 'volume_name': 'volume-9a6376a2-463b-4266-a9d8-471e773229eb', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47db0f25-68b9-419b-bc5a-94026c22a83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47db0f25-68b9-419b-bc5a-94026c22a83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad9da58-864e-4fcf-b732-b9861e72b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Volume 9a6376a2-463b-4266-a9d8-471e773229eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a6376a2-463b-4266-a9d8-471e773229eb', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Trying to clone 9a6376a2-463b-4266-a9d8-471e773229eb from image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]). {{(pid=82392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 16:14:46 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Image download 20.69 MB at 20.69 MB/s Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb17c422-e6f2-406a-8ae1-389afe5fa6a4]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:46 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD Apr 15 16:14:46 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:47 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Temporary image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 is fetched for user 11603785bdaa4fc0b71d812a3193a938. {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96e461-5fe4-4a16-9c3d-01f6cb061a4a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:47 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD Apr 15 16:14:47 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:47 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-297833281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6376a2-463b-4266-a9d8-471e773229eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97aabb198ff54bf6bd2e11fbca792aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:46Z,use_quota=True,user_id='11603785bdaa4fc0b71d812a3193a938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Creating volume 9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:14:47 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:14:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:47 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb 1073741824 Apr 15 16:14:47 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:48 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb 1073741824" returned: 0 in 0.461s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:48 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb Apr 15 16:14:48 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:48 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:14:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:48 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Attempting download of 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}])) to volume 9a6376a2-463b-4266-a9d8-471e773229eb. {{(pid=82392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 16:14:48 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3de5d7-a4c4-477b-a70c-085e9b091cd3]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_ahv74sbs {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:48 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_ahv74sbs Apr 15 16:14:48 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:49 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_ahv74sbs" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_ahv74sbs {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:49 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_ahv74sbs Apr 15 16:14:49 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:49 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_ahv74sbs" returned: 1 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_ahv74sbs' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:14:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb9a5d6-d66b-4ed3-bf64-bca00f512280]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:49 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD Apr 15 16:14:49 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:50 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:50 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 was qcow2, converting to raw {{(pid=82392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 16:14:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:50 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb Apr 15 16:14:50 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:50 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb" returned: 0 in 0.798s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:50 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_wjys0uu2devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:14:50 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 16:14:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:50 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb 1G Apr 15 16:14:50 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:51 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb 1G" returned: 0 in 0.420s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:51 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7e7b0-0e70-4cc1-8800-c79956cbf8d5]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:51 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb Apr 15 16:14:51 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:51 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb" returned: 0 in 0.467s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:51 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb Apr 15 16:14:51 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:52 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb" returned: 1 in 0.476s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Downloaded image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}])) to volume 9a6376a2-463b-4266-a9d8-471e773229eb successfully. {{(pid=82392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Temporary image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 for user 11603785bdaa4fc0b71d812a3193a938 is deleted. {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Marking volume 9a6376a2-463b-4266-a9d8-471e773229eb as bootable. {{(pid=82392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Copying metadata from image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 to 9a6376a2-463b-4266-a9d8-471e773229eb. {{(pid=82392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Creating volume glance metadata for volume 9a6376a2-463b-4266-a9d8-471e773229eb backed by image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad9da58-864e-4fcf-b732-b9861e72b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6376a2-463b-4266-a9d8-471e773229eb', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0962c96-5da1-4591-b737-f53d92891e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:52 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Volume volume-9a6376a2-463b-4266-a9d8-471e773229eb (9a6376a2-463b-4266-a9d8-471e773229eb): created successfully Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0962c96-5da1-4591-b737-f53d92891e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Flow 'volume_create_manager' (30b1949f-c196-4b3b-8d48-cb4fdba14c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:52 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f09c3242-276e-4ef3-8ee1-a3bad7afe525 tempest-VolumesImageMetadata-1504570992 None] Created volume successfully. Apr 15 16:14:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Acquiring lock "cinder-9a6376a2-463b-4266-a9d8-471e773229eb-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Lock "cinder-9a6376a2-463b-4266-a9d8-471e773229eb-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Acquiring lock "cinder-quobyte-9a6376a2-463b-4266-a9d8-471e773229eb" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Lock "cinder-quobyte-9a6376a2-463b-4266-a9d8-471e773229eb" acquired by "delete_volume" :: waited 0.017s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f20f86-654f-46d2-91a9-bc071179229e]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:53 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb Apr 15 16:14:53 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:53 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:53 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb Apr 15 16:14:53 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:53 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb" returned: 1 in 0.447s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:14:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:54 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb Apr 15 16:14:54 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:54 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a6376a2-463b-4266-a9d8-471e773229eb" returned: 0 in 0.407s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Lock "cinder-quobyte-9a6376a2-463b-4266-a9d8-471e773229eb" released by "delete_volume" :: held 1.353s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Created reservations ['01987bfa-5555-44fc-a759-2b0eecc8f70f', '5e28dd81-db0f-495c-98cd-9a790c5cdb2c', '42a42c66-46e6-4ac6-92c8-1670f26c01b2', '478547a8-0351-4951-a8a3-2d3e4645cd72'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:54 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:14:54 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:54 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.422s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:14:54 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Deleted volume successfully. Apr 15 16:14:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ddb0676b-bef7-4c62-9bc5-9b2e1a463f41 tempest-VolumesImageMetadata-1504570992 None] Lock "cinder-9a6376a2-463b-4266-a9d8-471e773229eb-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Flow 'volume_create_manager' (500baa9b-95e2-49df-9fc5-84a5f556f5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776be9c0-0636-423f-a45f-fe3c53aafd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776be9c0-0636-423f-a45f-fe3c53aafd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-510149814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c0620d-de01-4266-83d1-5a3beaf04166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab30e6369e6a4b2eb886d9b5c8a2a560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:59Z,use_quota=True,user_id='99253ef4fc5342178522e18e0a42cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402efd82-073e-4c23-85f8-3d3e8d6fdb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402efd82-073e-4c23-85f8-3d3e8d6fdb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9924712-88ba-46a6-973c-bb66deb4a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9924712-88ba-46a6-973c-bb66deb4a805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c0620d-de01-4266-83d1-5a3beaf04166', 'volume_name': 'volume-e8c0620d-de01-4266-83d1-5a3beaf04166', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8027edc3-9690-4489-aaa1-70458a4478fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8027edc3-9690-4489-aaa1-70458a4478fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f35d4e-ff2d-4cef-a0be-ef9ca0f49eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:58 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Volume e8c0620d-de01-4266-83d1-5a3beaf04166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c0620d-de01-4266-83d1-5a3beaf04166', 'volume_size': 1} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-510149814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c0620d-de01-4266-83d1-5a3beaf04166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab30e6369e6a4b2eb886d9b5c8a2a560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:14:59Z,use_quota=True,user_id='99253ef4fc5342178522e18e0a42cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Creating volume e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:14:58 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:14:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:58 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 1073741824 Apr 15 16:14:58 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:59 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 1073741824" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:14:59 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 Apr 15 16:14:59 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:14:59 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f35d4e-ff2d-4cef-a0be-ef9ca0f49eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c0620d-de01-4266-83d1-5a3beaf04166', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee72080-1da0-4881-8839-b3c571467cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:14:59 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Volume volume-e8c0620d-de01-4266-83d1-5a3beaf04166 (e8c0620d-de01-4266-83d1-5a3beaf04166): created successfully Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee72080-1da0-4881-8839-b3c571467cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:14:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Flow 'volume_create_manager' (500baa9b-95e2-49df-9fc5-84a5f556f5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:14:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-26409f68-0fbe-423e-8d25-af1eba89c513 tempest-VolumesDeleteCascade-887072277 None] Created volume successfully. Apr 15 16:15:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Creating offline snapshot 3da5051c-d4d7-4d07-b3e5-2cba2b1258ad of volume e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:15:00 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf98b2a1-64fe-4768-a3b8-7425c335fc08]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:00 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 Apr 15 16:15:00 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:01 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:01 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad 1G Apr 15 16:15:01 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:01 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad 1G" returned: 0 in 0.470s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:01 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad Apr 15 16:15:01 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:02 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:02 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad is being set with open permissions: ugo+rw Apr 15 16:15:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:02 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad Apr 15 16:15:02 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:02 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" returned: 0 in 0.401s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:02 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.info Apr 15 16:15:02 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:02 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.info" returned: 0 in 0.403s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:02 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.info is being set with open permissions: ugo+rw Apr 15 16:15:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:03 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.info Apr 15 16:15:03 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:03 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.info" returned: 0 in 0.399s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:03 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-51c3146b-7d6a-4a26-ae87-54a7bb71dc51 tempest-VolumesDeleteCascade-887072277 None] Create snapshot completed successfully Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:03 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:03 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Creating offline snapshot f564db86-ad91-417b-a8e6-ef8abfd76290 of volume e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc5aa63-cd61-452e-b6df-071525f158e2]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:04 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad Apr 15 16:15:04 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:04 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.417s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:04 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" returned: 0 in 0.468s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8c0620d-de01-4266-83d1-5a3beaf04166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:04 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 1G Apr 15 16:15:04 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:04 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 1G" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:04 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 Apr 15 16:15:04 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:05 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290" returned: 0 in 0.416s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:05 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 is being set with open permissions: ugo+rw Apr 15 16:15:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:05 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 Apr 15 16:15:05 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:05 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290" returned: 0 in 0.391s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:05 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-53fe48aa-7494-4ef5-a658-f13c450599a6 tempest-VolumesDeleteCascade-887072277 None] Create snapshot completed successfully Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-e8c0620d-de01-4266-83d1-5a3beaf04166-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-e8c0620d-de01-4266-83d1-5a3beaf04166-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Performing cascade delete. {{(pid=82392) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-3da5051c-d4d7-4d07-b3e5-2cba2b1258ad-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-3da5051c-d4d7-4d07-b3e5-2cba2b1258ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Deleting offline snapshot 3da5051c-d4d7-4d07-b3e5-2cba2b1258ad of volume e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] snapshot_file for this snap is: volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca404d5-f09d-44e2-bb5f-5628a622023a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:06 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad Apr 15 16:15:06 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:06 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" returned: 0 in 0.448s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8c0620d-de01-4266-83d1-5a3beaf04166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6d803a-ec93-4565-bdb2-7e607dc349eb]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:06 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 Apr 15 16:15:06 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:07 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:07 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace61364-1a37-41c0-8b7a-80b735a1eeba]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:07 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 Apr 15 16:15:07 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:07 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8c0620d-de01-4266-83d1-5a3beaf04166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:07 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff842fbb-fdba-4b76-96d7-521d0c8d846f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:07 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad Apr 15 16:15:07 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:08 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" returned: 0 in 0.456s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8c0620d-de01-4266-83d1-5a3beaf04166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d07c31-f582-450a-8d37-936eb034429c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:08 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 Apr 15 16:15:08 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:08 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166" returned: 0 in 0.471s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:08 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad Apr 15 16:15:08 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:08 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" returned: 0 in 0.431s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:09 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad Apr 15 16:15:09 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:09 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" returned: 0 in 0.393s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 -F qcow2 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:09 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 -F qcow2 Apr 15 16:15:09 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:09 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8c0620d-de01-4266-83d1-5a3beaf04166 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 -F qcow2" returned: 0 in 0.410s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-3da5051c-d4d7-4d07-b3e5-2cba2b1258ad" released by "_delete_snapshot" :: held 3.620s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" released by "delete_snapshot" :: held 3.633s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=87,cinder:INSERT=35,cinder:UPDATE=102,cinder:DELETE=8 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=95,cinder:INSERT=32,cinder:UPDATE=120,cinder:DELETE=11 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Created reservations ['9189cd27-5bc4-4a0d-a05d-81eec49d5731', '106a7e03-958e-4b4f-ac5d-87b0f7397443', '52bc8bf2-925d-41c3-9698-8497dc03152d', '739127b9-2036-4b0a-84ae-0787af64b16a'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:09 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Delete snapshot completed successfully. Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-3da5051c-d4d7-4d07-b3e5-2cba2b1258ad-delete_snapshot" released by "delete_snapshot" :: held 3.733s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-f564db86-ad91-417b-a8e6-ef8abfd76290-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-f564db86-ad91-417b-a8e6-ef8abfd76290-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-f564db86-ad91-417b-a8e6-ef8abfd76290" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-f564db86-ad91-417b-a8e6-ef8abfd76290" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Deleting offline snapshot f564db86-ad91-417b-a8e6-ef8abfd76290 of volume e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] snapshot_file for this snap is: volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6cdb32-1142-4852-b666-da5fb772100e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:10 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 Apr 15 16:15:10 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:10 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8c0620d-de01-4266-83d1-5a3beaf04166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:10 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f77b0-3d13-4c18-95d8-d178ad96c572]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:10 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 Apr 15 16:15:10 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:10 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166" returned: 0 in 0.456s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:10 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 Apr 15 16:15:10 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:11 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:11 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290 Apr 15 16:15:11 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:11 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166.f564db86-ad91-417b-a8e6-ef8abfd76290" returned: 0 in 0.413s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-f564db86-ad91-417b-a8e6-ef8abfd76290" released by "_delete_snapshot" :: held 1.789s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" released by "delete_snapshot" :: held 1.799s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Created reservations ['8d0dde1b-0db4-4e37-9f9c-5a82c4d18dca', '035a087f-acda-4ace-a65e-c0ac660b7924', '5fca07e5-46b0-4089-bbf7-4775bc3c763b', 'eb9f22d1-23c7-4b72-9715-945bcff77792'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:11 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Delete snapshot completed successfully. Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-f564db86-ad91-417b-a8e6-ef8abfd76290-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Snapshots deleted, issuing volume delete {{(pid=82392) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[62617590-7db8-4843-840f-015205868878]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:11 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 Apr 15 16:15:11 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:12 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:12 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166 Apr 15 16:15:12 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:12 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8c0620d-de01-4266-83d1-5a3beaf04166" returned: 0 in 0.393s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-e8c0620d-de01-4266-83d1-5a3beaf04166" released by "delete_volume" :: held 0.877s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Created reservations ['64878d25-3b0a-4135-b236-da75b76675cc', 'bd2a9d06-f3bb-4ee7-a333-b86ba87e8047', '96a9e419-31d0-484c-af07-0dff9b964771', '2b1732c2-f559-4fab-b701-61eeaefd8985'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:12 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:12 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:13 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:13 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Deleted volume successfully. Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb285904-13d9-4e68-8bf6-b2546a27e925 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-e8c0620d-de01-4266-83d1-5a3beaf04166-delete_volume" released by "delete_volume" :: held 7.060s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Flow 'volume_create_manager' (bf362428-485c-4c0d-82fd-9a7c25cb66bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b21bcc0-b9cb-4c7c-a1a7-5d24e6358245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b21bcc0-b9cb-4c7c-a1a7-5d24e6358245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1936215059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edbe34c-0b3a-4add-a7ea-71510f834769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab30e6369e6a4b2eb886d9b5c8a2a560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:14Z,use_quota=True,user_id='99253ef4fc5342178522e18e0a42cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f279f2-70cf-48a9-a3db-2f8e585ecb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f279f2-70cf-48a9-a3db-2f8e585ecb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e0d06d-a70e-41eb-993e-f9315241ff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e0d06d-a70e-41eb-993e-f9315241ff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edbe34c-0b3a-4add-a7ea-71510f834769', 'volume_name': 'volume-8edbe34c-0b3a-4add-a7ea-71510f834769', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926467bd-f703-435b-9817-edfdc2ddfa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926467bd-f703-435b-9817-edfdc2ddfa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b8363d-7420-4a61-8e16-e4f4f0d85a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:13 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Volume 8edbe34c-0b3a-4add-a7ea-71510f834769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edbe34c-0b3a-4add-a7ea-71510f834769', 'volume_size': 1} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1936215059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edbe34c-0b3a-4add-a7ea-71510f834769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab30e6369e6a4b2eb886d9b5c8a2a560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:14Z,use_quota=True,user_id='99253ef4fc5342178522e18e0a42cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Creating volume 8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:15:13 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:15:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:13 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 1073741824 Apr 15 16:15:13 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:14 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 1073741824" returned: 0 in 0.456s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:14 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 Apr 15 16:15:14 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:14 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769" returned: 0 in 0.411s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b8363d-7420-4a61-8e16-e4f4f0d85a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edbe34c-0b3a-4add-a7ea-71510f834769', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b7f8e5-aa21-41e8-ada2-678ed86a84c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:14 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Volume volume-8edbe34c-0b3a-4add-a7ea-71510f834769 (8edbe34c-0b3a-4add-a7ea-71510f834769): created successfully Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b7f8e5-aa21-41e8-ada2-678ed86a84c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:14 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Flow 'volume_create_manager' (bf362428-485c-4c0d-82fd-9a7c25cb66bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8e074462-bf18-44a6-8aff-554588fc57c7 tempest-VolumesDeleteCascade-887072277 None] Created volume successfully. Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Creating offline snapshot 623c6b38-d985-49fd-99ec-63affa29768e of volume 8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5d66f4-ceec-45f3-841f-035eb666ea74]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:16 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 Apr 15 16:15:16 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:16 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769" returned: 0 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:16 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e 1G Apr 15 16:15:16 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:16 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e 1G" returned: 0 in 0.484s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edbe34c-0b3a-4add-a7ea-71510f834769 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:17 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edbe34c-0b3a-4add-a7ea-71510f834769 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e Apr 15 16:15:17 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:17 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edbe34c-0b3a-4add-a7ea-71510f834769 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e" returned: 0 in 0.415s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:17 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e is being set with open permissions: ugo+rw Apr 15 16:15:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:17 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e Apr 15 16:15:17 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:17 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e" returned: 0 in 0.414s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:17 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.info Apr 15 16:15:17 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:18 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.info" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:18 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.info is being set with open permissions: ugo+rw Apr 15 16:15:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:18 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.info Apr 15 16:15:18 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:18 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.info" returned: 0 in 0.391s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:18 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-7cbd271f-c6bf-483a-9518-c5d9b529026a tempest-VolumesDeleteCascade-887072277 None] Create snapshot completed successfully Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Flow 'volume_create_manager' (cee64156-c34a-4174-9548-f6ebe7ff70d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6355f0da-93dd-4cc4-b27b-243cf7fea9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6355f0da-93dd-4cc4-b27b-243cf7fea9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-532220955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ecc901-3011-4f85-b67e-1839c1b6f940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab30e6369e6a4b2eb886d9b5c8a2a560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=623c6b38-d985-49fd-99ec-63affa29768e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:19Z,use_quota=True,user_id='99253ef4fc5342178522e18e0a42cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2df5dc-8c20-4acb-9232-825b0400ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2df5dc-8c20-4acb-9232-825b0400ec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56760b8a-3730-4a95-9b88-0c15b8105be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56760b8a-3730-4a95-9b88-0c15b8105be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34ecc901-3011-4f85-b67e-1839c1b6f940', 'volume_name': 'volume-34ecc901-3011-4f85-b67e-1839c1b6f940', 'volume_size': 1, 'snapshot_id': '623c6b38-d985-49fd-99ec-63affa29768e'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a275c72-d86b-4b54-94dc-9ae666d3d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a275c72-d86b-4b54-94dc-9ae666d3d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df01630-2146-4427-9909-0b43bb331171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:19 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Volume 34ecc901-3011-4f85-b67e-1839c1b6f940: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34ecc901-3011-4f85-b67e-1839c1b6f940', 'volume_size': 1, 'snapshot_id': '623c6b38-d985-49fd-99ec-63affa29768e'} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-623c6b38-d985-49fd-99ec-63affa29768e-34ecc901-3011-4f85-b67e-1839c1b6f940" by "_create_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-623c6b38-d985-49fd-99ec-63affa29768e-34ecc901-3011-4f85-b67e-1839c1b6f940" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Creating volume 34ecc901-3011-4f85-b67e-1839c1b6f940 from snapshot 623c6b38-d985-49fd-99ec-63affa29768e {{(pid=82392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-34ecc901-3011-4f85-b67e-1839c1b6f940" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-34ecc901-3011-4f85-b67e-1839c1b6f940" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] snapshot: 623c6b38-d985-49fd-99ec-63affa29768e, volume: 34ecc901-3011-4f85-b67e-1839c1b6f940, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5de032f-a474-48ab-a86c-4c30189b810a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:19 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e Apr 15 16:15:19 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:19 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e" returned: 0 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8edbe34c-0b3a-4add-a7ea-71510f834769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b178bce3-a90d-4cd8-8f65-221e4c081d01]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:20 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 Apr 15 16:15:20 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:20 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:20 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:15:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:20 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 Apr 15 16:15:20 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:22 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940" returned: 0 in 1.870s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:22 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b239db6-05bd-4f7a-9d2d-fea366d7b7be]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:22 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 Apr 15 16:15:22 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:22 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769" returned: 0 in 0.585s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:22 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769, size 1024.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:15:22 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Converted 1024.00 MB image at 547.32 MB/s Apr 15 16:15:22 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 is being set with open permissions: ugo+rw Apr 15 16:15:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:22 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 Apr 15 16:15:22 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:23 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940" returned: 0 in 0.415s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-34ecc901-3011-4f85-b67e-1839c1b6f940" released by "_copy_volume_from_snapshot" :: held 3.842s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-623c6b38-d985-49fd-99ec-63affa29768e-34ecc901-3011-4f85-b67e-1839c1b6f940" released by "_create_volume_from_snapshot" :: held 3.858s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.866s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df01630-2146-4427-9909-0b43bb331171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ecc901-3011-4f85-b67e-1839c1b6f940', 'volume_size': 1, 'snapshot_id': '623c6b38-d985-49fd-99ec-63affa29768e'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e7393c-f54e-4c2d-bba7-c6a3fc1e0538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:23 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Volume volume-34ecc901-3011-4f85-b67e-1839c1b6f940 (34ecc901-3011-4f85-b67e-1839c1b6f940): created successfully Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e7393c-f54e-4c2d-bba7-c6a3fc1e0538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Flow 'volume_create_manager' (cee64156-c34a-4174-9548-f6ebe7ff70d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:23 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-118aac81-8236-4564-a53d-ee02d7079054 tempest-VolumesDeleteCascade-887072277 None] Created volume successfully. Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-8edbe34c-0b3a-4add-a7ea-71510f834769-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-8edbe34c-0b3a-4add-a7ea-71510f834769-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Performing cascade delete. {{(pid=82392) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-623c6b38-d985-49fd-99ec-63affa29768e-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-623c6b38-d985-49fd-99ec-63affa29768e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-8edbe34c-0b3a-4add-a7ea-71510f834769" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-8edbe34c-0b3a-4add-a7ea-71510f834769" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-623c6b38-d985-49fd-99ec-63affa29768e" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-623c6b38-d985-49fd-99ec-63affa29768e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Deleting offline snapshot 623c6b38-d985-49fd-99ec-63affa29768e of volume 8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] snapshot_file for this snap is: volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8d9ed6-cc10-4f6b-9a7d-c0750b692b5a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:23 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e Apr 15 16:15:23 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:24 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e" returned: 0 in 0.491s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8edbe34c-0b3a-4add-a7ea-71510f834769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:24 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b2c419-a4f3-48ba-9029-596f3791e367]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:24 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 Apr 15 16:15:24 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:24 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769" returned: 0 in 0.445s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:24 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e Apr 15 16:15:24 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:25 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e" returned: 0 in 0.454s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:25 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e Apr 15 16:15:25 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:25 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769.623c6b38-d985-49fd-99ec-63affa29768e" returned: 0 in 0.386s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-623c6b38-d985-49fd-99ec-63affa29768e" released by "_delete_snapshot" :: held 1.823s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-8edbe34c-0b3a-4add-a7ea-71510f834769" released by "delete_snapshot" :: held 1.833s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Created reservations ['5691c493-88cc-47b4-9976-3f41b0c307cb', 'c50defa2-86f1-469b-a1b6-8f6765031617', '85eb6d39-148e-433c-bfd9-f2f64d463940', '07027ac8-a71d-4242-bf75-f5cd1f32baef'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:25 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Delete snapshot completed successfully. Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-623c6b38-d985-49fd-99ec-63affa29768e-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Snapshots deleted, issuing volume delete {{(pid=82392) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-8edbe34c-0b3a-4add-a7ea-71510f834769" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-8edbe34c-0b3a-4add-a7ea-71510f834769" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0642708-5a09-4fdd-bed5-e167aabe3f13]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:25 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 Apr 15 16:15:25 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:26 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769" returned: 0 in 0.444s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:26 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769 Apr 15 16:15:26 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:26 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8edbe34c-0b3a-4add-a7ea-71510f834769" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-8edbe34c-0b3a-4add-a7ea-71510f834769" released by "delete_volume" :: held 0.900s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Created reservations ['62a8c897-143e-44a9-b07c-431bc114da53', '4e1f9ec0-6080-49ee-8ca9-9d441a6d03a1', 'b7414707-7305-4726-9260-6bf68b8b980f', 'b300a6fb-8319-4772-8cd3-ae8688b21995'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:26 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:26 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-34ecc901-3011-4f85-b67e-1839c1b6f940-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-34ecc901-3011-4f85-b67e-1839c1b6f940-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "cinder-quobyte-34ecc901-3011-4f85-b67e-1839c1b6f940" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-34ecc901-3011-4f85-b67e-1839c1b6f940" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fd4d74-9248-4588-aecd-b878918415fb]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:27 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:27 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Deleted volume successfully. Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f9bba484-6acc-49f4-85da-63e46588559c tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-8edbe34c-0b3a-4add-a7ea-71510f834769-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:27 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 Apr 15 16:15:27 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:27 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:27 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940 Apr 15 16:15:27 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:27 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-34ecc901-3011-4f85-b67e-1839c1b6f940" returned: 0 in 0.422s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-quobyte-34ecc901-3011-4f85-b67e-1839c1b6f940" released by "delete_volume" :: held 0.907s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Created reservations ['79bdf1ba-2552-4457-b5a6-3648bf81d90b', 'c08c86bc-f034-4b11-abfd-582e686f5869', 'a576dc4e-9908-4c98-93a6-4a2bf847e253', '328ded18-60fd-4f97-91a6-86b3916456a5'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:28 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:28 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:28 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.441s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:28 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:28 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Deleted volume successfully. Apr 15 16:15:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1cf72dcc-8df5-4f58-a6eb-5fd0fd538ac7 tempest-VolumesDeleteCascade-887072277 None] Lock "cinder-34ecc901-3011-4f85-b67e-1839c1b6f940-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Flow 'volume_create_manager' (a25645d8-9b9e-4335-8e3b-6c4ed7c3c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0105132-0085-466d-96f4-4cb8e13626ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0105132-0085-466d-96f4-4cb8e13626ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1162099174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a47dbc2-2041-4a93-b790-e305ce237337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a24ca38e20420fb8fc597b81048c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:30Z,use_quota=True,user_id='fa8a14c1bbf843dbacee6dcd54195dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c4671c-a95b-42fb-b0f5-4c4bc62e245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c4671c-a95b-42fb-b0f5-4c4bc62e245b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae88b8f-4bde-4c7e-b0fe-5a49fa1bec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae88b8f-4bde-4c7e-b0fe-5a49fa1bec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a47dbc2-2041-4a93-b790-e305ce237337', 'volume_name': 'volume-8a47dbc2-2041-4a93-b790-e305ce237337', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd34e49-18f1-4e88-b188-784cbd6c06d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd34e49-18f1-4e88-b188-784cbd6c06d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5ddf15-5a68-4d78-8b14-575eea202276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:30 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Volume 8a47dbc2-2041-4a93-b790-e305ce237337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a47dbc2-2041-4a93-b790-e305ce237337', 'volume_size': 1} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1162099174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a47dbc2-2041-4a93-b790-e305ce237337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a24ca38e20420fb8fc597b81048c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:30Z,use_quota=True,user_id='fa8a14c1bbf843dbacee6dcd54195dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Creating volume 8a47dbc2-2041-4a93-b790-e305ce237337 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:15:30 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:15:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:30 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 1073741824 Apr 15 16:15:30 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:31 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 1073741824" returned: 0 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:31 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 Apr 15 16:15:31 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:31 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337" returned: 0 in 0.390s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5ddf15-5a68-4d78-8b14-575eea202276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a47dbc2-2041-4a93-b790-e305ce237337', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82e8368-f492-4d29-9553-8e7ba39d07eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:31 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Volume volume-8a47dbc2-2041-4a93-b790-e305ce237337 (8a47dbc2-2041-4a93-b790-e305ce237337): created successfully Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82e8368-f492-4d29-9553-8e7ba39d07eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:31 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Flow 'volume_create_manager' (a25645d8-9b9e-4335-8e3b-6c4ed7c3c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:31 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-07774f17-bab1-4892-b0e6-f507b397c99d tempest-VolumesTransfersV355Test-2127051844 None] Created volume successfully. Apr 15 16:15:31 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d54a81ec-3c44-4b0e-98c2-cb7722dd60a4 tempest-VolumesTransfersV355Test-2146770327 None] Transfer volume completed successfully. Apr 15 16:15:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Acquiring lock "cinder-8a47dbc2-2041-4a93-b790-e305ce237337-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Lock "cinder-8a47dbc2-2041-4a93-b790-e305ce237337-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Acquiring lock "cinder-quobyte-8a47dbc2-2041-4a93-b790-e305ce237337" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Lock "cinder-quobyte-8a47dbc2-2041-4a93-b790-e305ce237337" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:32 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4402195f-ca02-4c21-82e4-ea5e0e29a9a0]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:32 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 Apr 15 16:15:32 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:33 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:33 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337 Apr 15 16:15:33 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:33 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-8a47dbc2-2041-4a93-b790-e305ce237337" returned: 0 in 0.387s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Lock "cinder-quobyte-8a47dbc2-2041-4a93-b790-e305ce237337" released by "delete_volume" :: held 0.874s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Created reservations ['e9cfa57c-db61-47fb-a9a7-e992db53e92c', 'b15abdae-5caa-4818-abbc-e42a9dd42039', '943ca1d9-8f40-4f28-878b-0da4cb3dc7a6', '48deeb3c-50d6-4984-97cc-d96eb0dab054'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:33 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:33 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Flow 'volume_create_manager' (4606371b-400e-40e2-bbca-305601f99c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c401e8e3-9ae6-4804-a16a-3183bc340893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c401e8e3-9ae6-4804-a16a-3183bc340893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-780731750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bf3901-6c37-46a7-9b31-e704f2e768fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a24ca38e20420fb8fc597b81048c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:34Z,use_quota=True,user_id='fa8a14c1bbf843dbacee6dcd54195dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5499a79e-dd05-4f1a-8f20-061c0917b328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5499a79e-dd05-4f1a-8f20-061c0917b328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eaec33-85c4-439c-ae0a-a15d86578060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eaec33-85c4-439c-ae0a-a15d86578060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9bf3901-6c37-46a7-9b31-e704f2e768fa', 'volume_name': 'volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86464fd1-5ba5-4562-ac82-d5a7a4f23e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86464fd1-5ba5-4562-ac82-d5a7a4f23e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7637649-7948-4935-a9b3-0232ffb804c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:34 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Volume f9bf3901-6c37-46a7-9b31-e704f2e768fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa', 'volume_size': 1} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-780731750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bf3901-6c37-46a7-9b31-e704f2e768fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a24ca38e20420fb8fc597b81048c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:34Z,use_quota=True,user_id='fa8a14c1bbf843dbacee6dcd54195dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Creating volume f9bf3901-6c37-46a7-9b31-e704f2e768fa {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:34 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:15:34 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:34 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Deleted volume successfully. Apr 15 16:15:34 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa 1073741824 Apr 15 16:15:34 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-92ad0c38-474f-4927-9f80-e653ba6cdbb3 tempest-VolumesTransfersV355Test-53148556 None] Lock "cinder-8a47dbc2-2041-4a93-b790-e305ce237337-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:34 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa 1073741824" returned: 0 in 0.507s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:34 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa Apr 15 16:15:34 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:35 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:15:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7637649-7948-4935-a9b3-0232ffb804c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d1d9f7-4d80-4ddb-8433-b382d21581e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:35 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Volume volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa (f9bf3901-6c37-46a7-9b31-e704f2e768fa): created successfully Apr 15 16:15:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d1d9f7-4d80-4ddb-8433-b382d21581e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Flow 'volume_create_manager' (4606371b-400e-40e2-bbca-305601f99c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:35 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0a3fb6ab-b7b7-42fb-93f3-454b0f7ef519 tempest-VolumesTransfersV355Test-2127051844 None] Created volume successfully. Apr 15 16:15:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Acquiring lock "cinder-f9bf3901-6c37-46a7-9b31-e704f2e768fa-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Lock "cinder-f9bf3901-6c37-46a7-9b31-e704f2e768fa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Acquiring lock "cinder-quobyte-f9bf3901-6c37-46a7-9b31-e704f2e768fa" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Lock "cinder-quobyte-f9bf3901-6c37-46a7-9b31-e704f2e768fa" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:36 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[51224da6-4393-4097-a24d-7f33a81a9b19]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:36 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa Apr 15 16:15:36 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:36 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa" returned: 0 in 0.461s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:36 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa Apr 15 16:15:36 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:37 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-f9bf3901-6c37-46a7-9b31-e704f2e768fa" returned: 0 in 0.402s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Lock "cinder-quobyte-f9bf3901-6c37-46a7-9b31-e704f2e768fa" released by "delete_volume" :: held 0.883s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Created reservations ['ab52463b-ff91-4dd2-ae6d-66cde293a7e4', '6b834f26-edbf-4b69-9fff-6a9cb9373db1', '7fb37c3a-f343-4d79-9ab5-369ff9f4c1c2', '2f57bd6a-9277-467c-b033-6e26cfc5b96e'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:37 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:37 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:37 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.469s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:37 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Deleted volume successfully. Apr 15 16:15:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-02dd03c3-6bfd-4cbd-8af9-0f2aae0ab939 tempest-VolumesTransfersV355Test-53148556 None] Lock "cinder-f9bf3901-6c37-46a7-9b31-e704f2e768fa-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (3ec14a17-960b-4ad4-ad50-d64caa6df92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ea0aa9-7733-49a1-9ab9-48378534cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ea0aa9-7733-49a1-9ab9-48378534cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-43113041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6024e86-2a9b-47f9-a355-8463daf923c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:40Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91807172-3c2c-4781-a9f4-9bedcd9db4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91807172-3c2c-4781-a9f4-9bedcd9db4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a76a637-a588-4ddd-ad75-27514186e8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a76a637-a588-4ddd-ad75-27514186e8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6024e86-2a9b-47f9-a355-8463daf923c1', 'volume_name': 'volume-e6024e86-2a9b-47f9-a355-8463daf923c1', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebfe4b7-a011-4c6d-aee8-d9d493240ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebfe4b7-a011-4c6d-aee8-d9d493240ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce9d781-9023-43cd-98d8-e2603574dd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:40 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Volume e6024e86-2a9b-47f9-a355-8463daf923c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6024e86-2a9b-47f9-a355-8463daf923c1', 'volume_size': 1} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-43113041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6024e86-2a9b-47f9-a355-8463daf923c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:40Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Creating volume e6024e86-2a9b-47f9-a355-8463daf923c1 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:15:40 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:40 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 1073741824 Apr 15 16:15:40 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:40 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 1073741824" returned: 0 in 0.451s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:40 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 Apr 15 16:15:40 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:41 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1" returned: 0 in 0.386s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce9d781-9023-43cd-98d8-e2603574dd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6024e86-2a9b-47f9-a355-8463daf923c1', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f33daba-3f73-40a9-9491-b3c94f5b8001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:41 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Volume volume-e6024e86-2a9b-47f9-a355-8463daf923c1 (e6024e86-2a9b-47f9-a355-8463daf923c1): created successfully Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f33daba-3f73-40a9-9491-b3c94f5b8001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (3ec14a17-960b-4ad4-ad50-d64caa6df92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6f553613-a39f-47e5-90ae-fc52b884fadf tempest-VolumesGetTest-1363703057 None] Created volume successfully. Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (75f3fcde-5835-4874-92a0-3d444f2096f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44b8f1f-b189-4464-98be-02932609d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44b8f1f-b189-4464-98be-02932609d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-970341236',display_name='tempest-VolumesGetTest-Volume-1350844130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0fba5f-38b5-429a-a678-6f5e5eff2565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:42Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1963ed07-530b-4610-b53d-77ff32e0aeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1963ed07-530b-4610-b53d-77ff32e0aeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c418d8-f58c-42ae-ac35-97e50281c899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c418d8-f58c-42ae-ac35-97e50281c899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0fba5f-38b5-429a-a678-6f5e5eff2565', 'volume_name': 'volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e25c49-0dec-4da2-8269-bbc4be138b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e25c49-0dec-4da2-8269-bbc4be138b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e088e0f3-29ba-4d45-8d60-ec434510b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:41 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Volume 6b0fba5f-38b5-429a-a678-6f5e5eff2565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565', 'volume_size': 1} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-970341236',display_name='tempest-VolumesGetTest-Volume-1350844130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0fba5f-38b5-429a-a678-6f5e5eff2565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:42Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Creating volume 6b0fba5f-38b5-429a-a678-6f5e5eff2565 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:15:41 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:15:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:41 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 1073741824 Apr 15 16:15:41 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:42 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 1073741824" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:42 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 Apr 15 16:15:42 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:42 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565" returned: 0 in 0.399s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e088e0f3-29ba-4d45-8d60-ec434510b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3400a4c-e8a9-4b52-8d25-51663c8735e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:42 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Volume volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 (6b0fba5f-38b5-429a-a678-6f5e5eff2565): created successfully Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3400a4c-e8a9-4b52-8d25-51663c8735e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (75f3fcde-5835-4874-92a0-3d444f2096f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:42 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-979b13ac-a65e-4897-afeb-db861280080c tempest-VolumesGetTest-1363703057 None] Created volume successfully. Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-6b0fba5f-38b5-429a-a678-6f5e5eff2565-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Lock "cinder-6b0fba5f-38b5-429a-a678-6f5e5eff2565-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-6b0fba5f-38b5-429a-a678-6f5e5eff2565" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-6b0fba5f-38b5-429a-a678-6f5e5eff2565" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea373aa-d0cb-46d5-b096-85140badef97]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:44 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 Apr 15 16:15:44 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:44 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:44 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565 Apr 15 16:15:44 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:44 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-6b0fba5f-38b5-429a-a678-6f5e5eff2565" returned: 0 in 0.391s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-6b0fba5f-38b5-429a-a678-6f5e5eff2565" released by "delete_volume" :: held 0.877s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:44 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Created reservations ['ec07214a-ee85-47bd-ad28-815bfbf2e1ed', 'e294e24b-0125-407d-a2b4-29a3e56638c4', 'ff26a596-af71-47d1-9f4d-56e09095f664', 'c866a99f-3265-4673-ac7e-8fac0f60611d'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:45 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:45 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-e6024e86-2a9b-47f9-a355-8463daf923c1-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Lock "cinder-e6024e86-2a9b-47f9-a355-8463daf923c1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-e6024e86-2a9b-47f9-a355-8463daf923c1" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-e6024e86-2a9b-47f9-a355-8463daf923c1" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca22e0a-8d86-4a30-bf14-226268a0ce07]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:45 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 Apr 15 16:15:45 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:45 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.416s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:45 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Deleted volume successfully. Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-05f14295-29ce-41c6-875a-2ff31c0006ce tempest-VolumesGetTest-1363703057 None] Lock "cinder-6b0fba5f-38b5-429a-a678-6f5e5eff2565-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:45 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1" returned: 0 in 0.461s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:45 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1 Apr 15 16:15:45 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:46 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e6024e86-2a9b-47f9-a355-8463daf923c1" returned: 0 in 0.392s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-e6024e86-2a9b-47f9-a355-8463daf923c1" released by "delete_volume" :: held 0.878s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Created reservations ['2572f707-c728-451b-8944-7338c3db3dd2', '077371f4-7027-4e7f-814d-73fb541a6df9', '940336a2-ab01-4853-882d-80798e5e02dd', '016854e6-c196-4dc6-b29e-c97614fa61a3'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:46 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:46 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (a9b9a54a-3d5e-4358-860e-39a466a270de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9498f36-4a9c-4449-9a9b-d3daff39accb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9498f36-4a9c-4449-9a9b-d3daff39accb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-97486575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd7ad6b-ce33-4fe3-8524-3222418b5cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:47Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552245ae-0c03-44af-a8b5-a5cc24b3ea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552245ae-0c03-44af-a8b5-a5cc24b3ea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e9e960-121d-4f52-88b4-8100ab3dfb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e9e960-121d-4f52-88b4-8100ab3dfb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfd7ad6b-ce33-4fe3-8524-3222418b5cc7', 'volume_name': 'volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e262981b-c99f-44e7-9c45-1a626f74435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:46 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e262981b-c99f-44e7-9c45-1a626f74435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6448920-731d-40fe-ac29-9c1de4d418ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Volume cfd7ad6b-ce33-4fe3-8524-3222418b5cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7', 'volume_size': 1} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-97486575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd7ad6b-ce33-4fe3-8524-3222418b5cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:47Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Creating volume cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:15:46 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.431s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Deleted volume successfully. Apr 15 16:15:46 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 1073741824 Apr 15 16:15:46 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d2e825fb-b30d-4500-a9b1-05de50096e0d tempest-VolumesGetTest-1363703057 None] Lock "cinder-e6024e86-2a9b-47f9-a355-8463daf923c1-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:47 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 1073741824" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:47 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 Apr 15 16:15:47 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:47 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" returned: 0 in 0.389s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6448920-731d-40fe-ac29-9c1de4d418ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eecfd2-3366-446e-a899-4d1d36394ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Volume volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 (cfd7ad6b-ce33-4fe3-8524-3222418b5cc7): created successfully Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eecfd2-3366-446e-a899-4d1d36394ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (a9b9a54a-3d5e-4358-860e-39a466a270de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:47 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8a3ab400-58eb-4018-9e76-f03fef7dad8d tempest-VolumesGetTest-1363703057 None] Created volume successfully. Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (b04535c0-d84b-4085-9230-061a1b105b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d43493f-fe77-426c-8015-3ff4e9a5d1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d43493f-fe77-426c-8015-3ff4e9a5d1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1125306370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07581cf4-181e-436d-951a-dea884614b3b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cfd7ad6b-ce33-4fe3-8524-3222418b5cc7,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:48Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7e6ef9-f689-4d33-85e2-9d42dd274b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7e6ef9-f689-4d33-85e2-9d42dd274b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384f5b79-72f6-4d6a-ac7b-4776f2d8875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384f5b79-72f6-4d6a-ac7b-4776f2d8875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '07581cf4-181e-436d-951a-dea884614b3b', 'volume_name': 'volume-07581cf4-181e-436d-951a-dea884614b3b', 'volume_size': 1, 'source_volid': 'cfd7ad6b-ce33-4fe3-8524-3222418b5cc7', 'source_volstatus': 'available'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ecf406-786a-4de1-b95b-fef86c072658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ecf406-786a-4de1-b95b-fef86c072658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753b9c9f-cf04-449a-98bd-c34af2cf4a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Volume 07581cf4-181e-436d-951a-dea884614b3b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-07581cf4-181e-436d-951a-dea884614b3b', 'volume_size': 1, 'source_volid': 'cfd7ad6b-ce33-4fe3-8524-3222418b5cc7', 'source_volstatus': 'available'} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:47 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Cloning volume cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 to volume 07581cf4-181e-436d-951a-dea884614b3b Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Creating offline snapshot d73c1caf-0718-48f2-a907-a2efc8d35722 of volume cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[63010702-e677-40e6-85e5-20b2a6126ae2]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:48 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 Apr 15 16:15:48 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:48 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:48 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 1G Apr 15 16:15:48 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:48 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 1G" returned: 0 in 0.492s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:48 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 Apr 15 16:15:48 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:49 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722" returned: 0 in 0.426s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:49 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 is being set with open permissions: ugo+rw Apr 15 16:15:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:49 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 Apr 15 16:15:49 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:49 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722" returned: 0 in 0.393s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:49 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.info Apr 15 16:15:49 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:50 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.info" returned: 0 in 0.407s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:50 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.info is being set with open permissions: ugo+rw Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:50 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.info Apr 15 16:15:50 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:50 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.info" returned: 0 in 0.386s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-07581cf4-181e-436d-951a-dea884614b3b" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-07581cf4-181e-436d-951a-dea884614b3b" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] snapshot: d73c1caf-0718-48f2-a907-a2efc8d35722, volume: 07581cf4-181e-436d-951a-dea884614b3b, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fbeb62-ff4e-4476-b8c1-9270b72f8672]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:50 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 Apr 15 16:15:50 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:51 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722" returned: 0 in 0.448s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aa8621-b625-468e-851d-7d05cf8efda9]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:51 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 Apr 15 16:15:51 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:51 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" returned: 0 in 0.445s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:15:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:51 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b Apr 15 16:15:51 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:53 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b" returned: 0 in 1.855s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0cfbf7-d75a-45b0-aeb3-42a2a24d21f9]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:53 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 Apr 15 16:15:53 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:53 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" returned: 0 in 0.566s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:53 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7, size 1024.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:15:53 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Converted 1024.00 MB image at 551.53 MB/s Apr 15 16:15:53 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b is being set with open permissions: ugo+rw Apr 15 16:15:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:53 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b Apr 15 16:15:53 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:54 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b" returned: 0 in 0.394s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-07581cf4-181e-436d-951a-dea884614b3b" released by "_copy_volume_from_snapshot" :: held 3.753s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-d73c1caf-0718-48f2-a907-a2efc8d35722" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-d73c1caf-0718-48f2-a907-a2efc8d35722" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Deleting offline snapshot d73c1caf-0718-48f2-a907-a2efc8d35722 of volume cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] snapshot_file for this snap is: volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ef215-c7a2-40f7-a9b2-a08e311ed7ff]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:54 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 Apr 15 16:15:54 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:54 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722" returned: 0 in 0.448s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fca5f5-758d-450a-8e6e-2a645c23439e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:54 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 Apr 15 16:15:54 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:55 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:55 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 Apr 15 16:15:55 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:55 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722" returned: 0 in 0.432s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:55 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722 Apr 15 16:15:55 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:56 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7.d73c1caf-0718-48f2-a907-a2efc8d35722" returned: 0 in 0.394s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-d73c1caf-0718-48f2-a907-a2efc8d35722" released by "_delete_snapshot" :: held 1.803s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.236s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753b9c9f-cf04-449a-98bd-c34af2cf4a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07581cf4-181e-436d-951a-dea884614b3b', 'volume_size': 1, 'source_volid': 'cfd7ad6b-ce33-4fe3-8524-3222418b5cc7', 'source_volstatus': 'available'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90978d83-bd33-4221-b3eb-076779c1a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:56 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Volume volume-07581cf4-181e-436d-951a-dea884614b3b (07581cf4-181e-436d-951a-dea884614b3b): created successfully Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90978d83-bd33-4221-b3eb-076779c1a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (b04535c0-d84b-4085-9230-061a1b105b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:56 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5a04c9d0-da9b-4efd-b58e-b180ad0a37d3 tempest-VolumesGetTest-1363703057 None] Created volume successfully. Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (be0ae823-73e2-4a02-bc91-b614a3a95b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dac46c-647a-40de-b2e5-57aa7e99715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dac46c-647a-40de-b2e5-57aa7e99715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-645374952',display_name='tempest-VolumesGetTest-Volume-1892404881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91db00a3-06b9-4636-a330-8155986d8c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:57Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c273e099-db4d-4e49-b2dd-4456df712ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c273e099-db4d-4e49-b2dd-4456df712ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d8bff2-21c9-4e0d-9bc8-12e007ebf94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d8bff2-21c9-4e0d-9bc8-12e007ebf94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91db00a3-06b9-4636-a330-8155986d8c12', 'volume_name': 'volume-91db00a3-06b9-4636-a330-8155986d8c12', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4f20b3-bc6e-4d8a-9452-37e4460caff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4f20b3-bc6e-4d8a-9452-37e4460caff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5e6945-b2b6-4ccd-8b06-23ab5e28cca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:56 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Volume 91db00a3-06b9-4636-a330-8155986d8c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91db00a3-06b9-4636-a330-8155986d8c12', 'volume_size': 1} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:15:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-645374952',display_name='tempest-VolumesGetTest-Volume-1892404881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91db00a3-06b9-4636-a330-8155986d8c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:15:57Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Creating volume 91db00a3-06b9-4636-a330-8155986d8c12 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:15:56 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:15:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:56 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 1073741824 Apr 15 16:15:56 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:57 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 1073741824" returned: 0 in 0.481s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:57 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 Apr 15 16:15:57 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:57 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12" returned: 0 in 0.394s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5e6945-b2b6-4ccd-8b06-23ab5e28cca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91db00a3-06b9-4636-a330-8155986d8c12', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145a2bc4-fc53-40ef-b21e-f7cd6c1746c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:15:57 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Volume volume-91db00a3-06b9-4636-a330-8155986d8c12 (91db00a3-06b9-4636-a330-8155986d8c12): created successfully Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145a2bc4-fc53-40ef-b21e-f7cd6c1746c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (be0ae823-73e2-4a02-bc91-b614a3a95b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:15:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-7d23e852-09ff-4973-9526-9f0a3efe692c tempest-VolumesGetTest-1363703057 None] Created volume successfully. Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-91db00a3-06b9-4636-a330-8155986d8c12-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Lock "cinder-91db00a3-06b9-4636-a330-8155986d8c12-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-91db00a3-06b9-4636-a330-8155986d8c12" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-91db00a3-06b9-4636-a330-8155986d8c12" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a577531-b9a0-4177-b884-04bc22f8f54e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:58 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 Apr 15 16:15:58 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:58 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12" returned: 0 in 0.442s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:58 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12 Apr 15 16:15:58 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:58 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-91db00a3-06b9-4636-a330-8155986d8c12" returned: 0 in 0.388s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-91db00a3-06b9-4636-a330-8155986d8c12" released by "delete_volume" :: held 0.859s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Created reservations ['55fc0d4b-ba5e-4a72-8278-22d66b61085e', '237ac8da-c75a-46c7-959b-8b128700b75e', '43f902b5-8ed7-40a4-8360-0f688e41cea3', 'b843c00a-8b03-46b3-bc6c-3ae3ddd8216a'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:15:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:58 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:15:58 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-07581cf4-181e-436d-951a-dea884614b3b-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Lock "cinder-07581cf4-181e-436d-951a-dea884614b3b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-07581cf4-181e-436d-951a-dea884614b3b" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-07581cf4-181e-436d-951a-dea884614b3b" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a4bab-1ddb-4014-9d44-77a73a0fc957]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:59 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b Apr 15 16:15:59 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:15:59 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.408s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:15:59 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Deleted volume successfully. Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d36976b2-4e5a-44ba-9923-3548a8062258 tempest-VolumesGetTest-1363703057 None] Lock "cinder-91db00a3-06b9-4636-a330-8155986d8c12-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:15:59 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b" returned: 0 in 0.480s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:15:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:15:59 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b Apr 15 16:15:59 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:00 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-07581cf4-181e-436d-951a-dea884614b3b" returned: 0 in 0.393s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-07581cf4-181e-436d-951a-dea884614b3b" released by "delete_volume" :: held 0.911s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Created reservations ['7a796f7a-f821-400d-bcab-532b0d297ff6', 'a2895d88-5d53-4544-887d-2d046657df29', '46e29508-34b7-416c-9aa2-fd3a24d1c415', '6615c3c6-0526-4a38-819c-ae44387c2042'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:00 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:00 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Lock "cinder-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" acquired by "delete_volume" :: waited 0.019s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1f4b8f-47a7-45cb-8038-a304b5317a30]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:00 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 Apr 15 16:16:00 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:00 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.418s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:00 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Deleted volume successfully. Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cbf66d5-a0ad-425e-bcfd-7ecfffaa50d2 tempest-VolumesGetTest-1363703057 None] Lock "cinder-07581cf4-181e-436d-951a-dea884614b3b-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:00 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" returned: 0 in 0.489s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:00 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7 Apr 15 16:16:00 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:01 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" returned: 0 in 0.394s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7" released by "delete_volume" :: held 0.915s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Created reservations ['3ef2bf82-2146-4eda-bf23-6a82c55a3a71', '37a77512-e6d1-4afe-a60c-ad9293c3bb6d', '6d41193b-4c67-4cbb-964a-ee9381237c1b', 'a5b36671-d5f5-46fa-b091-f823f42e0539'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:01 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:01 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:01 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.442s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Deleted volume successfully. Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-58c70647-7f74-484d-94e8-f60d5b384332 tempest-VolumesGetTest-1363703057 None] Lock "cinder-cfd7ad6b-ce33-4fe3-8524-3222418b5cc7-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (6bbde0fb-4c2e-4b55-988d-a5cffd92792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68aa186-1dd7-4204-8a90-bbdcee7223fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68aa186-1dd7-4204-8a90-bbdcee7223fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1911000071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:02Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e340ab77-cac8-4bb6-a501-b31fd9b8ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e340ab77-cac8-4bb6-a501-b31fd9b8ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5a9735-9686-4879-998e-2bda24837ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.image.glance [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Creating Keystone auth plugin from conf {{(pid=82392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5a9735-9686-4879-998e-2bda24837ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25', 'volume_name': 'volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be806480-c4e3-4f1f-8afc-aa4efc3fb166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be806480-c4e3-4f1f-8afc-aa4efc3fb166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8830cc2-54a7-4a80-abd8-8a6a9ebff7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:02 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Volume e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 16:16:02 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Trying to clone e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 from image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]). {{(pid=82392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 16:16:02 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 16:16:02 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Image download 20.69 MB at 20.69 MB/s Apr 15 16:16:02 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[786600ed-2db6-4bf1-ad44-bad62cfd5e3f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:02 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD Apr 15 16:16:02 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:02 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:02 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Temporary image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 is fetched for user a7d9ca6ed8b9445b974839eaef77c85f. {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 16:16:02 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c556c16-9235-416a-a9fd-63367206018b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:02 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD Apr 15 16:16:02 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:03 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1911000071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:02Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Creating volume e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:03 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:03 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 1073741824 Apr 15 16:16:03 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:03 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 1073741824" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:03 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 Apr 15 16:16:03 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:03 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:03 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:04 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" returned: 0 in 0.418s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Attempting download of 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}])) to volume e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25. {{(pid=82392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75727a9-10c9-46c0-9809-6db4a04bfe14]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_xnep7m5r {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:04 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_xnep7m5r Apr 15 16:16:04 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:04 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.402s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:04 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_xnep7m5r" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_xnep7m5r {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:04 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_xnep7m5r Apr 15 16:16:04 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:04 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_xnep7m5r" returned: 1 in 0.434s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_xnep7m5r' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26138de-c965-4320-8bb6-74f737200db4]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:05 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD Apr 15 16:16:05 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:05 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:05 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 was qcow2, converting to raw {{(pid=82392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 16:16:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:05 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 Apr 15 16:16:05 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:06 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" returned: 0 in 0.847s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:06 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f3c0715-fef1-45bf-b596-a4af9a1c2d21_2kfpr351devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:16:06 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 16:16:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:06 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 1G Apr 15 16:16:06 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:06 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 1G" returned: 0 in 0.422s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf0fec7-46bf-4645-89f8-0d17ec67eeff]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:06 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 Apr 15 16:16:06 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:07 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" returned: 0 in 0.480s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:07 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 Apr 15 16:16:07 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:07 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" returned: 1 in 0.449s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Downloaded image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}])) to volume e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 successfully. {{(pid=82392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Temporary image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 for user a7d9ca6ed8b9445b974839eaef77c85f is deleted. {{(pid=82392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.volume.volume_utils [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Marking volume e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 as bootable. {{(pid=82392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Copying metadata from image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 to e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25. {{(pid=82392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Creating volume glance metadata for volume e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 backed by image 7f3c0715-fef1-45bf-b596-a4af9a1c2d21 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8830cc2-54a7-4a80-abd8-8a6a9ebff7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25', 'volume_size': 1, 'image_id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6cde409cf0b44439cdec5225d887b16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f3c0715-fef1-45bf-b596-a4af9a1c2d21', 'created_at': datetime.datetime(2026, 4, 15, 14, 2, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 2, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f3c0715-fef1-45bf-b596-a4af9a1c2d21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b025ad3b-8622-4d7e-8cdb-3f4c92045abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:07 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Volume volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 (e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25): created successfully Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b025ad3b-8622-4d7e-8cdb-3f4c92045abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (6bbde0fb-4c2e-4b55-988d-a5cffd92792c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:07 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-dd94295d-0248-4cf2-b7c3-d7ddcd0a40b6 tempest-VolumesGetTest-1363703057 None] Created volume successfully. Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (1f330414-7eb0-429f-868b-d82753ac4076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da3478d-ac7f-4776-b2e1-5b6ff80ab074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da3478d-ac7f-4776-b2e1-5b6ff80ab074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1243385016',display_name='tempest-VolumesGetTest-Volume-776503696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac85830-7966-45cc-9d12-d0a6634f5a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:08Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530e83ba-a893-43fe-bc91-d77d7c440855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530e83ba-a893-43fe-bc91-d77d7c440855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ed2947-8fd2-4f33-951e-dcafb7cb34b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ed2947-8fd2-4f33-951e-dcafb7cb34b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac85830-7966-45cc-9d12-d0a6634f5a08', 'volume_name': 'volume-eac85830-7966-45cc-9d12-d0a6634f5a08', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef84ffd3-ce2b-4507-b362-cf2de56ad9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef84ffd3-ce2b-4507-b362-cf2de56ad9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520aa54c-9d2e-4d42-a274-0a425a7b408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:08 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Volume eac85830-7966-45cc-9d12-d0a6634f5a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac85830-7966-45cc-9d12-d0a6634f5a08', 'volume_size': 1} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1243385016',display_name='tempest-VolumesGetTest-Volume-776503696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac85830-7966-45cc-9d12-d0a6634f5a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e36b644cc348da85bf7d7cfee6f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:08Z,use_quota=True,user_id='a7d9ca6ed8b9445b974839eaef77c85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Creating volume eac85830-7966-45cc-9d12-d0a6634f5a08 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:08 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:08 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 1073741824 Apr 15 16:16:08 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:08 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 1073741824" returned: 0 in 0.471s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:09 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 Apr 15 16:16:09 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:09 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08" returned: 0 in 0.419s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520aa54c-9d2e-4d42-a274-0a425a7b408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac85830-7966-45cc-9d12-d0a6634f5a08', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa27cfb-c011-4066-9def-4f5e35242752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:09 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Volume volume-eac85830-7966-45cc-9d12-d0a6634f5a08 (eac85830-7966-45cc-9d12-d0a6634f5a08): created successfully Apr 15 16:16:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa27cfb-c011-4066-9def-4f5e35242752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Flow 'volume_create_manager' (1f330414-7eb0-429f-868b-d82753ac4076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:09 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8e36f8f0-426a-4e1c-ab04-bca507afb622 tempest-VolumesGetTest-1363703057 None] Created volume successfully. Apr 15 16:16:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-eac85830-7966-45cc-9d12-d0a6634f5a08-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Lock "cinder-eac85830-7966-45cc-9d12-d0a6634f5a08-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:10 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=100,cinder:INSERT=42,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:16:10 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=101,cinder:UPDATE=143,cinder:INSERT=36,cinder:DELETE=13 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:16:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-eac85830-7966-45cc-9d12-d0a6634f5a08" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-eac85830-7966-45cc-9d12-d0a6634f5a08" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:10 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb1664d-c628-4335-bc9b-18378de79299]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:10 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 Apr 15 16:16:10 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:11 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08" returned: 0 in 0.476s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:11 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08 Apr 15 16:16:11 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:11 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-eac85830-7966-45cc-9d12-d0a6634f5a08" returned: 0 in 0.400s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-eac85830-7966-45cc-9d12-d0a6634f5a08" released by "delete_volume" :: held 0.898s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Created reservations ['cfc10381-c837-489e-b82e-959aac5cf67e', 'cbb6b543-046f-4c99-9f33-f662f4ddf771', '69686a3b-6aa2-4e57-bcd5-927be4b7ef07', '1b552277-318e-48c2-8bae-6ad6e2699e21'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:11 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:11 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Lock "cinder-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Acquiring lock "cinder-quobyte-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f009520-6782-4e83-a9a9-5e18d4ff32df]: (4, 'raw') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:11 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 Apr 15 16:16:11 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:12 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.459s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:12 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:12 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Deleted volume successfully. Apr 15 16:16:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e60b936e-e79f-4173-9c95-269ea8af39d0 tempest-VolumesGetTest-1363703057 None] Lock "cinder-eac85830-7966-45cc-9d12-d0a6634f5a08-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:12 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" returned: 0 in 0.495s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:12 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 Apr 15 16:16:12 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:12 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" returned: 1 in 0.448s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25' failed. Not Retrying. {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 16:16:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:12 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25 Apr 15 16:16:12 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:13 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" returned: 0 in 0.401s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Lock "cinder-quobyte-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25" released by "delete_volume" :: held 1.395s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Created reservations ['1a99e747-338f-4c33-a8ee-a04d8cbdd62a', '40b2f3d0-ffc8-4fe9-9042-e0a9e379c66f', '234d0844-9c51-4b1b-a9fa-a59c317c7216', '1b1d0411-9cc1-43aa-a2d4-195391f15788'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:13 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:13 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:13 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.419s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:13 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Deleted volume successfully. Apr 15 16:16:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ed4ba6b6-4f2c-4ed5-92df-d94ae3692d4c tempest-VolumesGetTest-1363703057 None] Lock "cinder-e8b0e0b3-95bf-4618-84bf-6b3b1aea4a25-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Flow 'volume_create_manager' (01059b2a-2bc6-406a-8c86-85d7969747d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f0eeb4-3820-4aa7-8a4d-2d10f66efd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f0eeb4-3820-4aa7-8a4d-2d10f66efd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-354402766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72723f95-f0cf-4b15-b802-228268d74614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33002aa38fd64b0b8b391277362ed219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:16Z,use_quota=True,user_id='f6bfcb6a0ae94c2f9e2269216181442c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9a3dc9-d61d-4b60-9690-c50acd2bec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9a3dc9-d61d-4b60-9690-c50acd2bec48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4981a3-9a66-46de-9849-ce19548a0722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4981a3-9a66-46de-9849-ce19548a0722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72723f95-f0cf-4b15-b802-228268d74614', 'volume_name': 'volume-72723f95-f0cf-4b15-b802-228268d74614', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9c832c-8740-4628-83e8-0f9e6507433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9c832c-8740-4628-83e8-0f9e6507433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a7fc78-b9ed-47f0-8ec8-0b5a0ee9c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:15 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Volume 72723f95-f0cf-4b15-b802-228268d74614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72723f95-f0cf-4b15-b802-228268d74614', 'volume_size': 1} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-354402766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72723f95-f0cf-4b15-b802-228268d74614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33002aa38fd64b0b8b391277362ed219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:16Z,use_quota=True,user_id='f6bfcb6a0ae94c2f9e2269216181442c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Creating volume 72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:15 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:15 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 1073741824 Apr 15 16:16:15 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:16 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 1073741824" returned: 0 in 0.493s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:16 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 Apr 15 16:16:16 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:16 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614" returned: 0 in 0.439s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a7fc78-b9ed-47f0-8ec8-0b5a0ee9c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72723f95-f0cf-4b15-b802-228268d74614', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3f044f-9cb9-434e-90ac-2aef0fbd0f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:16 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Volume volume-72723f95-f0cf-4b15-b802-228268d74614 (72723f95-f0cf-4b15-b802-228268d74614): created successfully Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3f044f-9cb9-434e-90ac-2aef0fbd0f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:16 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Flow 'volume_create_manager' (01059b2a-2bc6-406a-8c86-85d7969747d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:16 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-fe3a7dc1-c932-4090-9aff-69cd3d4d3209 tempest-VolumesSnapshotListTestJSON-830258521 None] Created volume successfully. Apr 15 16:16:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:17 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Creating offline snapshot 5370cee3-6f13-4bef-96e0-1b8258652c71 of volume 72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:16:17 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7933af-8045-4ec2-8e6d-38286d5938af]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:17 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 Apr 15 16:16:17 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:18 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614" returned: 0 in 0.482s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:18 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 1G Apr 15 16:16:18 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:18 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 1G" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:18 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 Apr 15 16:16:18 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:19 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71" returned: 0 in 0.415s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:19 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 is being set with open permissions: ugo+rw Apr 15 16:16:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:19 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 Apr 15 16:16:19 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:19 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71" returned: 0 in 0.383s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:19 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.info Apr 15 16:16:19 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:20 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.info" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:20 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.info is being set with open permissions: ugo+rw Apr 15 16:16:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:20 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.info Apr 15 16:16:20 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:20 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.info" returned: 0 in 0.387s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-632c59fb-f987-4038-8532-07914d426aea tempest-VolumesSnapshotListTestJSON-830258521 None] Create snapshot completed successfully Apr 15 16:16:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Creating offline snapshot c3afc73b-9ec3-421a-a569-31fd3ba1e77b of volume 72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:16:21 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[812839ee-e57f-41fd-b535-2682614f63ef]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:21 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 Apr 15 16:16:21 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:21 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71" returned: 0 in 0.454s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72723f95-f0cf-4b15-b802-228268d74614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:16:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:21 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b 1G Apr 15 16:16:21 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:22 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b 1G" returned: 0 in 0.497s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:22 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b Apr 15 16:16:22 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:22 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b" returned: 0 in 0.427s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:22 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b is being set with open permissions: ugo+rw Apr 15 16:16:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:22 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b Apr 15 16:16:22 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:22 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b" returned: 0 in 0.387s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:22 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-4b84230d-d0cd-48e6-a4a2-f065696bf0e3 tempest-VolumesSnapshotListTestJSON-830258521 None] Create snapshot completed successfully Apr 15 16:16:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Creating offline snapshot 8d291565-532f-4b3d-b88b-6cae4d49d7ab of volume 72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:16:23 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[62461dbc-86c4-4afd-a370-a01237e7350f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:23 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b Apr 15 16:16:23 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:23 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72723f95-f0cf-4b15-b802-228268d74614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:16:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:23 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab 1G Apr 15 16:16:23 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:24 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab 1G" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:24 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab Apr 15 16:16:24 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:24 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab" returned: 0 in 0.406s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:24 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab is being set with open permissions: ugo+rw Apr 15 16:16:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:24 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab Apr 15 16:16:24 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:24 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab" returned: 0 in 0.391s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:25 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6271256a-a1e4-4231-ac5c-36ed78223ea9 tempest-VolumesSnapshotListTestJSON-830258521 None] Create snapshot completed successfully Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-8d291565-532f-4b3d-b88b-6cae4d49d7ab-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-8d291565-532f-4b3d-b88b-6cae4d49d7ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-quobyte-8d291565-532f-4b3d-b88b-6cae4d49d7ab" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-8d291565-532f-4b3d-b88b-6cae4d49d7ab" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Deleting offline snapshot 8d291565-532f-4b3d-b88b-6cae4d49d7ab of volume 72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] snapshot_file for this snap is: volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef6942-e178-4e45-bd46-94b00c39ddde]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:26 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab Apr 15 16:16:26 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:26 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72723f95-f0cf-4b15-b802-228268d74614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e248f-3b77-4c7a-b656-90af4f7c0edc]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:26 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b Apr 15 16:16:26 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:27 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b" returned: 0 in 0.460s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72723f95-f0cf-4b15-b802-228268d74614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:27 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab Apr 15 16:16:27 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:27 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:27 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab Apr 15 16:16:27 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:27 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.8d291565-532f-4b3d-b88b-6cae4d49d7ab" returned: 0 in 0.398s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-8d291565-532f-4b3d-b88b-6cae4d49d7ab" released by "_delete_snapshot" :: held 1.834s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" released by "delete_snapshot" :: held 1.845s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Created reservations ['9a76e80b-eba3-4af1-ab85-badcae827cf7', '83f042fa-139f-43bb-84ee-444b6b280db6', 'ee9097b9-b664-4529-a083-c9c25a719034', 'b0d57dff-06ad-489a-8f26-7240869b416b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:27 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Delete snapshot completed successfully. Apr 15 16:16:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-08ecb725-1325-473f-99ad-8dc96a91d52a tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-8d291565-532f-4b3d-b88b-6cae4d49d7ab-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-c3afc73b-9ec3-421a-a569-31fd3ba1e77b-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-c3afc73b-9ec3-421a-a569-31fd3ba1e77b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-quobyte-c3afc73b-9ec3-421a-a569-31fd3ba1e77b" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-c3afc73b-9ec3-421a-a569-31fd3ba1e77b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Deleting offline snapshot c3afc73b-9ec3-421a-a569-31fd3ba1e77b of volume 72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] snapshot_file for this snap is: volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5dfae5-8a9a-4ee8-8650-24f9978335bf]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:28 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b Apr 15 16:16:28 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:28 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72723f95-f0cf-4b15-b802-228268d74614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93cb194-f86d-40ba-82ae-afca03d24648]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:28 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 Apr 15 16:16:28 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:29 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71" returned: 0 in 0.442s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72723f95-f0cf-4b15-b802-228268d74614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:29 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b Apr 15 16:16:29 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:29 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b" returned: 0 in 0.445s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:29 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b Apr 15 16:16:29 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:29 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.c3afc73b-9ec3-421a-a569-31fd3ba1e77b" returned: 0 in 0.386s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-c3afc73b-9ec3-421a-a569-31fd3ba1e77b" released by "_delete_snapshot" :: held 1.783s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" released by "delete_snapshot" :: held 1.794s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:29 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Created reservations ['4863cd85-e61a-4c6d-a1a3-9d1634c73665', '6d924a02-5184-458a-a660-84a767af0b93', '2f1b4263-482b-430b-8adc-dc86f52919ed', '9bdec4f0-4896-4e3f-9c01-e475027d6ad3'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:30 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Delete snapshot completed successfully. Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-09f49cdb-f96c-415b-b817-e50454569b18 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-c3afc73b-9ec3-421a-a569-31fd3ba1e77b-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-5370cee3-6f13-4bef-96e0-1b8258652c71-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-5370cee3-6f13-4bef-96e0-1b8258652c71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-quobyte-5370cee3-6f13-4bef-96e0-1b8258652c71" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-5370cee3-6f13-4bef-96e0-1b8258652c71" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Deleting offline snapshot 5370cee3-6f13-4bef-96e0-1b8258652c71 of volume 72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] snapshot_file for this snap is: volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb4777d-8078-4093-8630-cc8b893ff42d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:30 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 Apr 15 16:16:30 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:30 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72723f95-f0cf-4b15-b802-228268d74614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee872ad-7ca2-486b-bd86-c8411893b9ab]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:30 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 Apr 15 16:16:30 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:31 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:31 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 Apr 15 16:16:31 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:31 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:31 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71 Apr 15 16:16:31 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:32 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614.5370cee3-6f13-4bef-96e0-1b8258652c71" returned: 0 in 0.405s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-5370cee3-6f13-4bef-96e0-1b8258652c71" released by "_delete_snapshot" :: held 1.826s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" released by "delete_snapshot" :: held 1.838s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Created reservations ['fde6563d-29cc-4dfb-808d-06c45a95fea0', '5d8c5abb-3946-479e-9dcb-76b74bdfef47', '6a1e5766-3280-4136-9b00-8c479ea5afba', '0df0c26e-fe8d-48d8-a55e-942c4023f1d9'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:32 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Delete snapshot completed successfully. Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d0a43169-afd2-4c5b-828f-351aa059b3d4 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-5370cee3-6f13-4bef-96e0-1b8258652c71-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-72723f95-f0cf-4b15-b802-228268d74614-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-72723f95-f0cf-4b15-b802-228268d74614-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55a9557-f1ce-42cd-b28c-d942a924292d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:32 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 Apr 15 16:16:32 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:32 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614" returned: 0 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:32 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614 Apr 15 16:16:32 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:33 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-72723f95-f0cf-4b15-b802-228268d74614" returned: 0 in 0.397s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-quobyte-72723f95-f0cf-4b15-b802-228268d74614" released by "delete_volume" :: held 0.883s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Created reservations ['4266f62e-12d8-45fd-a3bb-b24cdef5cb42', 'ff3479e9-d734-4c97-863b-c50dc5956d6f', '6e041812-ce7d-46b5-adf6-1c32855a462b', '019b931c-7d05-414b-a120-b605a40d2eff'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:33 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:33 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:33 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.414s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:33 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Deleted volume successfully. Apr 15 16:16:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c910ef42-b386-4b50-b0f5-6656896d2125 tempest-VolumesSnapshotListTestJSON-830258521 None] Lock "cinder-72723f95-f0cf-4b15-b802-228268d74614-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Flow 'volume_create_manager' (19730d0d-a552-4d5c-a4ce-43265a4d9923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbefb93a-79e6-44c3-b6b6-e3851895e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbefb93a-79e6-44c3-b6b6-e3851895e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-76192935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845979c5-c00c-43ec-88d2-688af7c07ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98fddde4f08a498c8753afb286a490de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:35Z,use_quota=True,user_id='e96759b0fb2c417387a4bc63fbf5a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72f1508-6ccc-4a68-82a4-38e28a6e875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72f1508-6ccc-4a68-82a4-38e28a6e875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813a59b4-06cc-43ec-81b8-10debcf808d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813a59b4-06cc-43ec-81b8-10debcf808d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845979c5-c00c-43ec-88d2-688af7c07ee6', 'volume_name': 'volume-845979c5-c00c-43ec-88d2-688af7c07ee6', 'volume_size': 2}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5aa43a-da46-40cd-ab15-1cc01a05e193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5aa43a-da46-40cd-ab15-1cc01a05e193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f6dc1b-9627-483a-9ed6-795d4a2f665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:35 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Volume 845979c5-c00c-43ec-88d2-688af7c07ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845979c5-c00c-43ec-88d2-688af7c07ee6', 'volume_size': 2} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-76192935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845979c5-c00c-43ec-88d2-688af7c07ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98fddde4f08a498c8753afb286a490de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:35Z,use_quota=True,user_id='e96759b0fb2c417387a4bc63fbf5a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Creating volume 845979c5-c00c-43ec-88d2-688af7c07ee6 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:35 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 2147483648 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:35 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 2147483648 Apr 15 16:16:35 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:35 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 2147483648" returned: 0 in 0.530s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:35 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 Apr 15 16:16:35 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:36 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6" returned: 0 in 0.402s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f6dc1b-9627-483a-9ed6-795d4a2f665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845979c5-c00c-43ec-88d2-688af7c07ee6', 'volume_size': 2}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d80734-e01b-4293-9323-df4125247f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:36 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Volume volume-845979c5-c00c-43ec-88d2-688af7c07ee6 (845979c5-c00c-43ec-88d2-688af7c07ee6): created successfully Apr 15 16:16:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d80734-e01b-4293-9323-df4125247f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Flow 'volume_create_manager' (19730d0d-a552-4d5c-a4ce-43265a4d9923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:36 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-20045ec3-bc5a-4857-80e9-7c24e31502fa tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Created volume successfully. Apr 15 16:16:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Creating offline snapshot bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 of volume 845979c5-c00c-43ec-88d2-688af7c07ee6 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:16:37 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaeedce-3563-498a-9d98-60378d007872]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:37 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 Apr 15 16:16:37 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:37 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 2G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:37 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 2G Apr 15 16:16:37 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:38 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 2G" returned: 0 in 0.447s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845979c5-c00c-43ec-88d2-688af7c07ee6 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:38 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845979c5-c00c-43ec-88d2-688af7c07ee6 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 Apr 15 16:16:38 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:38 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845979c5-c00c-43ec-88d2-688af7c07ee6 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51" returned: 0 in 0.406s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:38 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 is being set with open permissions: ugo+rw Apr 15 16:16:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:38 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 Apr 15 16:16:38 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:39 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51" returned: 0 in 0.389s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:39 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.info Apr 15 16:16:39 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:39 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.info" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:39 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.info is being set with open permissions: ugo+rw Apr 15 16:16:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:39 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.info Apr 15 16:16:39 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:39 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.info" returned: 0 in 0.381s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:39 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c2cf0dd5-a06b-4217-80c2-3c0b1e23adca tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Create snapshot completed successfully Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "cinder-bc3e5a32-ea9f-4411-9529-eff1a1b5ac51-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-bc3e5a32-ea9f-4411-9529-eff1a1b5ac51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "cinder-quobyte-845979c5-c00c-43ec-88d2-688af7c07ee6" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-quobyte-845979c5-c00c-43ec-88d2-688af7c07ee6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "cinder-quobyte-bc3e5a32-ea9f-4411-9529-eff1a1b5ac51" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-quobyte-bc3e5a32-ea9f-4411-9529-eff1a1b5ac51" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Deleting offline snapshot bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 of volume 845979c5-c00c-43ec-88d2-688af7c07ee6 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] snapshot_file for this snap is: volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[091cc618-a4ea-404d-ad61-a0b20d3e30c2]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:40 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 Apr 15 16:16:40 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:41 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51" returned: 0 in 0.456s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-845979c5-c00c-43ec-88d2-688af7c07ee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:16:41 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[970c14b4-b681-4472-a370-d2a05eebcb64]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:41 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 Apr 15 16:16:41 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:41 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6" returned: 0 in 0.443s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:41 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 Apr 15 16:16:41 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:41 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:42 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51 Apr 15 16:16:42 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:42 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6.bc3e5a32-ea9f-4411-9529-eff1a1b5ac51" returned: 0 in 0.384s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-quobyte-bc3e5a32-ea9f-4411-9529-eff1a1b5ac51" released by "_delete_snapshot" :: held 1.787s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-quobyte-845979c5-c00c-43ec-88d2-688af7c07ee6" released by "delete_snapshot" :: held 1.797s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Created reservations ['c137a03f-a667-4073-89e8-fe5e63ff37e1', '294ecdd7-a0e5-4225-be0c-52b16e0617ff', '6c1a8038-a1e5-4674-9759-720ffa6f7c98', '0229ba4f-50ac-4549-b731-70fd8bbe5029'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:42 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Delete snapshot completed successfully. Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-fcc6625f-9f41-4969-b556-3abf900751f7 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-bc3e5a32-ea9f-4411-9529-eff1a1b5ac51-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "cinder-845979c5-c00c-43ec-88d2-688af7c07ee6-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-845979c5-c00c-43ec-88d2-688af7c07ee6-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "cinder-quobyte-845979c5-c00c-43ec-88d2-688af7c07ee6" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-quobyte-845979c5-c00c-43ec-88d2-688af7c07ee6" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fb2cf5-b767-4ef3-b934-c2983e595d2d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:42 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 Apr 15 16:16:42 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:43 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6" returned: 0 in 0.440s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:43 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6 Apr 15 16:16:43 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:43 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-845979c5-c00c-43ec-88d2-688af7c07ee6" returned: 0 in 0.386s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-quobyte-845979c5-c00c-43ec-88d2-688af7c07ee6" released by "delete_volume" :: held 0.862s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Created reservations ['dc028ed3-814b-46d4-9e61-18f6874640c8', 'ffc0ada3-ae4d-4bb2-b2ff-f92a3def3354', '7375e89d-cb4a-49c1-8bd3-60705706d8c7', '1602a5ac-522e-4af6-aebf-55fab389925b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:43 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:43 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:44 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.411s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:44 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:44 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Deleted volume successfully. Apr 15 16:16:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac7071b2-beb0-44b3-ad1a-e95c8c695be6 tempest-VolumesSnapshotNegativeTestJSON-1766956527 None] Lock "cinder-845979c5-c00c-43ec-88d2-688af7c07ee6-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (d9419693-fdeb-4cd3-8d04-ae71471fe781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051a40fd-45d4-426a-b337-539539e50e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051a40fd-45d4-426a-b337-539539e50e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811203970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0baa31-72c7-4c25-aaa2-820fda518295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:45Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0907db1-48a8-4fde-90e6-0796cf9627df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0907db1-48a8-4fde-90e6-0796cf9627df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729f4a27-2190-4bbb-88ac-045fff3558e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729f4a27-2190-4bbb-88ac-045fff3558e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0baa31-72c7-4c25-aaa2-820fda518295', 'volume_name': 'volume-4c0baa31-72c7-4c25-aaa2-820fda518295', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aee3781-ff37-497f-8813-7ee1419e06ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aee3781-ff37-497f-8813-7ee1419e06ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779f9eac-b6aa-40e0-95f3-08469eba501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:45 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume 4c0baa31-72c7-4c25-aaa2-820fda518295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0baa31-72c7-4c25-aaa2-820fda518295', 'volume_size': 1} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811203970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0baa31-72c7-4c25-aaa2-820fda518295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:45Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Creating volume 4c0baa31-72c7-4c25-aaa2-820fda518295 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:45 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:45 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 1073741824 Apr 15 16:16:45 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:45 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 1073741824" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:45 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 Apr 15 16:16:45 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:46 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295" returned: 0 in 0.392s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779f9eac-b6aa-40e0-95f3-08469eba501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0baa31-72c7-4c25-aaa2-820fda518295', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafd8f07-a8e6-41dd-b304-c15d3888d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume volume-4c0baa31-72c7-4c25-aaa2-820fda518295 (4c0baa31-72c7-4c25-aaa2-820fda518295): created successfully Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafd8f07-a8e6-41dd-b304-c15d3888d94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (d9419693-fdeb-4cd3-8d04-ae71471fe781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-9f6e2ea5-81b3-4496-88bd-db92d01ed4e2 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created volume successfully. Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (3b18ac00-f424-4968-8c1e-7a4558a09080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0871f6-e224-4f65-af07-3e43a49ab7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0871f6-e224-4f65-af07-3e43a49ab7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-156127209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da70894-cfb6-4ed3-b31c-d586fb4f93f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d32b57-07ad-4f78-9b38-712e3dc2631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d32b57-07ad-4f78-9b38-712e3dc2631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07769681-fdf3-4d3b-8007-c6c85a10226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07769681-fdf3-4d3b-8007-c6c85a10226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da70894-cfb6-4ed3-b31c-d586fb4f93f9', 'volume_name': 'volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e382b082-683a-47b2-8a21-0d97c5acc379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e382b082-683a-47b2-8a21-0d97c5acc379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5db5ead-9ed4-44c3-8b31-0311412f28c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume 0da70894-cfb6-4ed3-b31c-d586fb4f93f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9', 'volume_size': 1} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-156127209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da70894-cfb6-4ed3-b31c-d586fb4f93f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Creating volume 0da70894-cfb6-4ed3-b31c-d586fb4f93f9 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:46 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:46 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 1073741824 Apr 15 16:16:46 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (807318f3-b344-4290-8997-fb0706fcc204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8a2287-94ee-4982-b4fb-2c3689d88718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8a2287-94ee-4982-b4fb-2c3689d88718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1673195040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3518270b-73df-4744-aa04-8b9b21d73aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93637d3c-9fc4-40ff-9887-6c5d46a9fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93637d3c-9fc4-40ff-9887-6c5d46a9fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cabbfb3-5eda-417e-b911-6db1bdf154ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cabbfb3-5eda-417e-b911-6db1bdf154ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3518270b-73df-4744-aa04-8b9b21d73aab', 'volume_name': 'volume-3518270b-73df-4744-aa04-8b9b21d73aab', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05eac03-d99f-4a71-b6fa-c4e4f4b1971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05eac03-d99f-4a71-b6fa-c4e4f4b1971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cbcc57-45b7-4748-b360-b7299d709d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:46 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume 3518270b-73df-4744-aa04-8b9b21d73aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3518270b-73df-4744-aa04-8b9b21d73aab', 'volume_size': 1} Apr 15 16:16:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (72146d14-5ff2-47da-bde8-283f2cd34298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d48a01-08ad-4bdb-8d14-5fdeee41909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d48a01-08ad-4bdb-8d14-5fdeee41909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586063771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92568aa-5ac1-4f1a-976d-40bcb38afe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c9a637-c6a8-4d2d-94e2-5c4995d41962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c9a637-c6a8-4d2d-94e2-5c4995d41962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542efef5-34e7-41a2-addf-d81af2b39187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542efef5-34e7-41a2-addf-d81af2b39187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92568aa-5ac1-4f1a-976d-40bcb38afe17', 'volume_name': 'volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99091619-e6f6-45ca-988a-3b085cee88b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99091619-e6f6-45ca-988a-3b085cee88b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7370cd2a-a5d8-4b51-9e7f-e39c45c69112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume b92568aa-5ac1-4f1a-976d-40bcb38afe17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17', 'volume_size': 1} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (f361b518-fc66-4a96-84f1-528b51075645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a07de22-7b17-4a37-acd1-a021674ee2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a07de22-7b17-4a37-acd1-a021674ee2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393003763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce46654-0aac-4af4-8611-6488fefc8859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd8f670-4ccd-4df8-be36-b6b791c6d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd8f670-4ccd-4df8-be36-b6b791c6d48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff54ba9e-de0f-46fc-ac68-222f33c28285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff54ba9e-de0f-46fc-ac68-222f33c28285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce46654-0aac-4af4-8611-6488fefc8859', 'volume_name': 'volume-1ce46654-0aac-4af4-8611-6488fefc8859', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9993d964-10ec-45c5-a1f9-d4fc473a1c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9993d964-10ec-45c5-a1f9-d4fc473a1c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5b1cf1-2b6a-4ab8-958e-29382517854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume 1ce46654-0aac-4af4-8611-6488fefc8859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce46654-0aac-4af4-8611-6488fefc8859', 'volume_size': 1} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 1073741824" returned: 0 in 0.559s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:47 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 Apr 15 16:16:47 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (e39cb9ce-b416-48cb-9320-3d9264bc3fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855edb17-45fe-4fb4-b806-5e21cf99c616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855edb17-45fe-4fb4-b806-5e21cf99c616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210409027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76f21ad-1e2b-4e50-90f3-f22301afd70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7116e449-7581-4ced-b896-268c37d2abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7116e449-7581-4ced-b896-268c37d2abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259779ac-0630-46b3-8f36-1040d1612e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259779ac-0630-46b3-8f36-1040d1612e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76f21ad-1e2b-4e50-90f3-f22301afd70e', 'volume_name': 'volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedec62a-47cd-4557-9f30-7b3908c292a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedec62a-47cd-4557-9f30-7b3908c292a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebe1237-257d-4658-a1e5-51c419adcfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume c76f21ad-1e2b-4e50-90f3-f22301afd70e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e', 'volume_size': 1} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:47 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9" returned: 0 in 0.404s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1673195040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3518270b-73df-4744-aa04-8b9b21d73aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Creating volume 3518270b-73df-4744-aa04-8b9b21d73aab {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:47 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5db5ead-9ed4-44c3-8b31-0311412f28c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab 1073741824 Apr 15 16:16:47 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e67eca-1319-4709-97ba-bc687d9f758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 (0da70894-cfb6-4ed3-b31c-d586fb4f93f9): created successfully Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e67eca-1319-4709-97ba-bc687d9f758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (3b18ac00-f424-4968-8c1e-7a4558a09080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:47 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c6685f7c-c176-4e97-b77d-6730293ed574 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created volume successfully. Apr 15 16:16:48 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab 1073741824" returned: 0 in 0.480s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:48 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab Apr 15 16:16:48 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:48 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab" returned: 0 in 0.413s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586063771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92568aa-5ac1-4f1a-976d-40bcb38afe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Creating volume b92568aa-5ac1-4f1a-976d-40bcb38afe17 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:48 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cbcc57-45b7-4748-b360-b7299d709d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3518270b-73df-4744-aa04-8b9b21d73aab', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:48 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 1073741824 Apr 15 16:16:48 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e24e7a-62e1-4ada-8795-e0079b042fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume volume-3518270b-73df-4744-aa04-8b9b21d73aab (3518270b-73df-4744-aa04-8b9b21d73aab): created successfully Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e24e7a-62e1-4ada-8795-e0079b042fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (807318f3-b344-4290-8997-fb0706fcc204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-26752c96-dd8a-4866-b03b-709da517a933 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created volume successfully. Apr 15 16:16:49 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 1073741824" returned: 0 in 0.485s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:49 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 Apr 15 16:16:49 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:49 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17" returned: 0 in 0.391s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.253s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393003763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce46654-0aac-4af4-8611-6488fefc8859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Creating volume 1ce46654-0aac-4af4-8611-6488fefc8859 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:49 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7370cd2a-a5d8-4b51-9e7f-e39c45c69112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:49 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 1073741824 Apr 15 16:16:49 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939a2767-2e76-4b6e-87fb-a3883f8821b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:49 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 (b92568aa-5ac1-4f1a-976d-40bcb38afe17): created successfully Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939a2767-2e76-4b6e-87fb-a3883f8821b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:49 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (72146d14-5ff2-47da-bde8-283f2cd34298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:49 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-24540965-fb1f-45bd-87cb-69aa445bdb45 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created volume successfully. Apr 15 16:16:50 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 1073741824" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:50 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 Apr 15 16:16:50 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:50 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859" returned: 0 in 0.387s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.920s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210409027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76f21ad-1e2b-4e50-90f3-f22301afd70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0542e5796634ac49cdb187bae59e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:16:47Z,use_quota=True,user_id='83a3dba29c1d400296326026e4dfce0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Creating volume c76f21ad-1e2b-4e50-90f3-f22301afd70e {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:16:50 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5b1cf1-2b6a-4ab8-958e-29382517854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce46654-0aac-4af4-8611-6488fefc8859', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c777d8d-221c-4192-b936-3f1a8a6e3dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:50 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e 1073741824 Apr 15 16:16:50 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:50 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume volume-1ce46654-0aac-4af4-8611-6488fefc8859 (1ce46654-0aac-4af4-8611-6488fefc8859): created successfully Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c777d8d-221c-4192-b936-3f1a8a6e3dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (f361b518-fc66-4a96-84f1-528b51075645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:50 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-3aa58403-3a1d-4237-aec2-9d065698c01b tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created volume successfully. Apr 15 16:16:50 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e 1073741824" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:50 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e Apr 15 16:16:50 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:51 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e" returned: 0 in 0.387s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebe1237-257d-4658-a1e5-51c419adcfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5110284a-2cfa-4263-8013-5a13ae7f53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:16:51 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Volume volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e (c76f21ad-1e2b-4e50-90f3-f22301afd70e): created successfully Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5110284a-2cfa-4263-8013-5a13ae7f53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Flow 'volume_create_manager' (e39cb9ce-b416-48cb-9320-3d9264bc3fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:16:51 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-82ccc41c-a23e-45ba-a045-96e268508270 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created volume successfully. Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-c76f21ad-1e2b-4e50-90f3-f22301afd70e-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-c76f21ad-1e2b-4e50-90f3-f22301afd70e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-quobyte-c76f21ad-1e2b-4e50-90f3-f22301afd70e" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-c76f21ad-1e2b-4e50-90f3-f22301afd70e" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c4fb85-06bd-409e-967e-c1e2e779781b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:51 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e Apr 15 16:16:51 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:52 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e" returned: 0 in 0.448s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:52 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e Apr 15 16:16:52 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:52 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c76f21ad-1e2b-4e50-90f3-f22301afd70e" returned: 0 in 0.391s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-c76f21ad-1e2b-4e50-90f3-f22301afd70e" released by "delete_volume" :: held 0.868s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created reservations ['08a905cf-7952-40be-a51f-92eb0d886907', '85412ea1-7b60-4f77-bb8c-b1236645c7ba', '923b43fc-daca-40ea-a6bc-6419c0117f5c', 'b7d49784-8bb6-48b3-b508-fe0393a8d259'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:52 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:52 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-1ce46654-0aac-4af4-8611-6488fefc8859-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-1ce46654-0aac-4af4-8611-6488fefc8859-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-quobyte-1ce46654-0aac-4af4-8611-6488fefc8859" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-1ce46654-0aac-4af4-8611-6488fefc8859" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[020103d0-b403-43f6-b75a-0f8d8a0627ef]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:53 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 Apr 15 16:16:53 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:53 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.414s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:53 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Deleted volume successfully. Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-03357d08-bd72-4f28-873f-38007c71f93d tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-c76f21ad-1e2b-4e50-90f3-f22301afd70e-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:53 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859" returned: 0 in 0.461s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:53 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859 Apr 15 16:16:53 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:53 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-1ce46654-0aac-4af4-8611-6488fefc8859" returned: 0 in 0.390s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-1ce46654-0aac-4af4-8611-6488fefc8859" released by "delete_volume" :: held 0.874s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created reservations ['6c0ff50f-67cd-4030-b2f4-47e3c4a6ed89', '77d153ca-f081-493a-9ba8-ec6690419de8', '1dd51fb2-23ba-4eaa-bd25-4e152beac687', 'dc167112-0f39-4f56-9028-764e09200219'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:53 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:53 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-b92568aa-5ac1-4f1a-976d-40bcb38afe17-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-b92568aa-5ac1-4f1a-976d-40bcb38afe17-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-quobyte-b92568aa-5ac1-4f1a-976d-40bcb38afe17" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-b92568aa-5ac1-4f1a-976d-40bcb38afe17" acquired by "delete_volume" :: waited 0.018s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ed55a7-a498-4bbb-9952-11eb1cf7dda6]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:54 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 Apr 15 16:16:54 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:54 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.421s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:54 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Deleted volume successfully. Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbbb6caa-399b-4645-926c-bb9cd3afcfb7 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-1ce46654-0aac-4af4-8611-6488fefc8859-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:54 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17" returned: 0 in 0.451s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:54 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17 Apr 15 16:16:54 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:54 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b92568aa-5ac1-4f1a-976d-40bcb38afe17" returned: 0 in 0.386s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-b92568aa-5ac1-4f1a-976d-40bcb38afe17" released by "delete_volume" :: held 0.857s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created reservations ['e83788f9-45e2-4bf0-86e3-d7b233f4d032', 'e51383ad-9476-432e-886d-fa49e00240ad', '57ac76d0-b08b-48bc-9b51-a4090c212d49', 'cef94c9f-8011-47e6-bcc2-666af2c6908e'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:55 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:55 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-3518270b-73df-4744-aa04-8b9b21d73aab-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-3518270b-73df-4744-aa04-8b9b21d73aab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-quobyte-3518270b-73df-4744-aa04-8b9b21d73aab" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-3518270b-73df-4744-aa04-8b9b21d73aab" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[595f6ff9-0c17-4928-8adc-5a0c3b5a74e4]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:55 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab Apr 15 16:16:55 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:55 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.425s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:55 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Deleted volume successfully. Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-392d3997-0b3f-4291-ba0e-824f3adc608f tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-b92568aa-5ac1-4f1a-976d-40bcb38afe17-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:55 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:55 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab Apr 15 16:16:55 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:56 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3518270b-73df-4744-aa04-8b9b21d73aab" returned: 0 in 0.395s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-3518270b-73df-4744-aa04-8b9b21d73aab" released by "delete_volume" :: held 0.879s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created reservations ['b256ebed-b096-40a7-a510-f278d60cf87c', '098b56bb-b603-4c80-8eec-477d0bb0ba1f', '83660220-b90a-45d7-909d-1aaa17cd61f4', '8207b8c5-84e3-40ea-a385-7d185334eabc'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:56 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:56 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-0da70894-cfb6-4ed3-b31c-d586fb4f93f9-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-0da70894-cfb6-4ed3-b31c-d586fb4f93f9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-quobyte-0da70894-cfb6-4ed3-b31c-d586fb4f93f9" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-0da70894-cfb6-4ed3-b31c-d586fb4f93f9" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e5e44-145f-4674-ab42-ea56d6d96353]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:56 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 Apr 15 16:16:56 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:56 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.436s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:56 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Deleted volume successfully. Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c842835d-90a3-4942-b17c-f33458487949 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-3518270b-73df-4744-aa04-8b9b21d73aab-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:56 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9" returned: 0 in 0.460s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:56 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9 Apr 15 16:16:56 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:57 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0da70894-cfb6-4ed3-b31c-d586fb4f93f9" returned: 0 in 0.395s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-0da70894-cfb6-4ed3-b31c-d586fb4f93f9" released by "delete_volume" :: held 0.881s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created reservations ['3f251667-102f-474b-afd0-1e6c9757d187', '6ac492f2-0257-4573-8001-37e1570d877a', '4f7e1c80-56ae-490f-8e46-bb3eae7c12ff', 'c5506e2a-3272-4d46-a1c1-792f6e2721b4'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:57 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:57 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-4c0baa31-72c7-4c25-aaa2-820fda518295-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-4c0baa31-72c7-4c25-aaa2-820fda518295-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "cinder-quobyte-4c0baa31-72c7-4c25-aaa2-820fda518295" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-4c0baa31-72c7-4c25-aaa2-820fda518295" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6360dcf3-1380-4cee-989e-df249387fb37]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:57 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 Apr 15 16:16:57 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:57 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.416s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Deleted volume successfully. Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-960360ca-8f03-445b-86a1-e97f6ffcd4cd tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-0da70894-cfb6-4ed3-b31c-d586fb4f93f9-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:57 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:57 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295 Apr 15 16:16:57 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:58 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4c0baa31-72c7-4c25-aaa2-820fda518295" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-quobyte-4c0baa31-72c7-4c25-aaa2-820fda518295" released by "delete_volume" :: held 0.870s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Created reservations ['10c81fa0-614d-413d-93d6-21f1f8b4261f', '9d46d135-ae48-442a-b4d2-5284334528e9', '6be735cf-9898-4520-8a18-2dc3f073b6e9', '91064967-3ef8-4cdd-a286-c3ed7938b6ca'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:16:58 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:16:58 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:16:58 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:16:58 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Deleted volume successfully. Apr 15 16:16:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-f19302a1-87af-46b7-b37f-6523da0a6ac4 tempest-CreateVolumesFromSourceVolumeTest-1059724232 None] Lock "cinder-4c0baa31-72c7-4c25-aaa2-820fda518295-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Flow 'volume_create_manager' (81835c7d-9181-4099-a17d-0a9846ba011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85f4db9-de82-45ea-b678-bc36c65b6acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85f4db9-de82-45ea-b678-bc36c65b6acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e519eb40-8d06-4255-adf5-a38e9dbaeae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223a1480556d4a26ab4e1c43a8ac2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:00Z,use_quota=True,user_id='4fb87844e2b14bbaac4f2631a0f38685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1faeea0-ea0f-4c66-a820-b7157fbd25e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1faeea0-ea0f-4c66-a820-b7157fbd25e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b36eda2-5585-4234-82d8-f77c276447a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b36eda2-5585-4234-82d8-f77c276447a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e519eb40-8d06-4255-adf5-a38e9dbaeae5', 'volume_name': 'volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5e474b-178e-4cc4-9f69-dcd51010bb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5e474b-178e-4cc4-9f69-dcd51010bb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb1bf2c-4617-42db-bcad-552a6850667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Volume e519eb40-8d06-4255-adf5-a38e9dbaeae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5', 'volume_size': 1} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e519eb40-8d06-4255-adf5-a38e9dbaeae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223a1480556d4a26ab4e1c43a8ac2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:00Z,use_quota=True,user_id='4fb87844e2b14bbaac4f2631a0f38685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Creating volume e519eb40-8d06-4255-adf5-a38e9dbaeae5 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:00 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:00 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 1073741824 Apr 15 16:17:00 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:00 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 1073741824" returned: 0 in 0.492s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:00 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 Apr 15 16:17:00 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:01 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5" returned: 0 in 0.409s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb1bf2c-4617-42db-bcad-552a6850667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d482250f-c51e-43e4-955b-816be421180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:01 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Volume volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 (e519eb40-8d06-4255-adf5-a38e9dbaeae5): created successfully Apr 15 16:17:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d482250f-c51e-43e4-955b-816be421180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:01 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Flow 'volume_create_manager' (81835c7d-9181-4099-a17d-0a9846ba011d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:01 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-dabdce0b-ef10-434e-a08d-cd29f6ed8341 tempest-CinderUnicodeTest-459334178 None] Created volume successfully. Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Flow 'volume_create_manager' (56221a4b-3f3e-48b9-8156-0aa329336de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bda8901-6521-4166-87f8-f486bac0dc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bda8901-6521-4166-87f8-f486bac0dc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1621280075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15452774-3e06-4d30-935c-23f1cf93b430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223a1480556d4a26ab4e1c43a8ac2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:02Z,use_quota=True,user_id='4fb87844e2b14bbaac4f2631a0f38685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6db7519-4b83-460b-87a2-ea5b3714b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6db7519-4b83-460b-87a2-ea5b3714b35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025825bf-8e80-43f8-b921-b1865a7ed8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025825bf-8e80-43f8-b921-b1865a7ed8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15452774-3e06-4d30-935c-23f1cf93b430', 'volume_name': 'volume-15452774-3e06-4d30-935c-23f1cf93b430', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4858db-f3b3-4641-b9ac-ba86c26d62e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4858db-f3b3-4641-b9ac-ba86c26d62e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60681787-fa33-46d6-b609-215b33cc5bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:02 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Volume 15452774-3e06-4d30-935c-23f1cf93b430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15452774-3e06-4d30-935c-23f1cf93b430', 'volume_size': 1} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1621280075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15452774-3e06-4d30-935c-23f1cf93b430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223a1480556d4a26ab4e1c43a8ac2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:02Z,use_quota=True,user_id='4fb87844e2b14bbaac4f2631a0f38685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Creating volume 15452774-3e06-4d30-935c-23f1cf93b430 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:02 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:02 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 1073741824 Apr 15 16:17:02 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:02 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 1073741824" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:03 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 Apr 15 16:17:03 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:03 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430" returned: 0 in 0.395s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60681787-fa33-46d6-b609-215b33cc5bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15452774-3e06-4d30-935c-23f1cf93b430', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6448fc-3720-4013-86ac-15662443d232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:03 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Volume volume-15452774-3e06-4d30-935c-23f1cf93b430 (15452774-3e06-4d30-935c-23f1cf93b430): created successfully Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6448fc-3720-4013-86ac-15662443d232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Flow 'volume_create_manager' (56221a4b-3f3e-48b9-8156-0aa329336de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:03 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-dcd3c65a-4025-41be-b9d5-b9d9a3cdc79c tempest-CinderUnicodeTest-459334178 None] Created volume successfully. Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Creating offline snapshot c3a093be-7f8c-40e6-b9e4-178de3947a15 of volume 15452774-3e06-4d30-935c-23f1cf93b430 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[af139654-a769-4d4e-8db1-ecc333420fa3]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:03 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 Apr 15 16:17:03 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:03 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:03 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:04 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:04 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 1G Apr 15 16:17:04 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:04 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.414s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:04 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 1G" returned: 0 in 0.461s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15452774-3e06-4d30-935c-23f1cf93b430 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:04 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15452774-3e06-4d30-935c-23f1cf93b430 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 Apr 15 16:17:04 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:05 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15452774-3e06-4d30-935c-23f1cf93b430 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15" returned: 0 in 0.411s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:05 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 is being set with open permissions: ugo+rw Apr 15 16:17:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:05 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 Apr 15 16:17:05 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:05 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15" returned: 0 in 0.382s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:05 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.info Apr 15 16:17:05 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:05 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.info" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:05 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.info is being set with open permissions: ugo+rw Apr 15 16:17:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:05 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.info Apr 15 16:17:05 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:06 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.info" returned: 0 in 0.397s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:06 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-8e37d661-766b-4a2b-a412-6c8b564d24e4 tempest-CinderUnicodeTest-459334178 None] Create snapshot completed successfully Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Acquiring lock "cinder-c3a093be-7f8c-40e6-b9e4-178de3947a15-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Lock "cinder-c3a093be-7f8c-40e6-b9e4-178de3947a15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Acquiring lock "cinder-quobyte-15452774-3e06-4d30-935c-23f1cf93b430" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Lock "cinder-quobyte-15452774-3e06-4d30-935c-23f1cf93b430" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Acquiring lock "cinder-quobyte-c3a093be-7f8c-40e6-b9e4-178de3947a15" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Lock "cinder-quobyte-c3a093be-7f8c-40e6-b9e4-178de3947a15" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Deleting offline snapshot c3a093be-7f8c-40e6-b9e4-178de3947a15 of volume 15452774-3e06-4d30-935c-23f1cf93b430 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] snapshot_file for this snap is: volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce312a2f-8bed-4fe7-9896-a9fbe912a156]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:06 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 Apr 15 16:17:06 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:07 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15" returned: 0 in 0.446s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15452774-3e06-4d30-935c-23f1cf93b430(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:17:07 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c29cb6e-7f5f-4392-b3c4-329fb4ef002e]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:07 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 Apr 15 16:17:07 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:07 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:07 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 Apr 15 16:17:07 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:08 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15" returned: 0 in 0.434s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:08 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15 Apr 15 16:17:08 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:08 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430.c3a093be-7f8c-40e6-b9e4-178de3947a15" returned: 0 in 0.382s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Lock "cinder-quobyte-c3a093be-7f8c-40e6-b9e4-178de3947a15" released by "_delete_snapshot" :: held 1.776s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Lock "cinder-quobyte-15452774-3e06-4d30-935c-23f1cf93b430" released by "delete_snapshot" :: held 1.787s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Created reservations ['d7b97ba4-df67-40e5-990e-804a44f13861', '388a348e-a65a-437f-9dc9-9da8122ef756', '200dec1d-2a71-4d0c-b9cb-b39e53d0e40e', 'fd6b0b6b-78db-4165-9f20-c05f1deba880'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:08 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Delete snapshot completed successfully. Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-d8700145-893b-44c7-84fb-34061b4f078e tempest-CinderUnicodeTest-459334178 None] Lock "cinder-c3a093be-7f8c-40e6-b9e4-178de3947a15-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Acquiring lock "cinder-15452774-3e06-4d30-935c-23f1cf93b430-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Lock "cinder-15452774-3e06-4d30-935c-23f1cf93b430-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Acquiring lock "cinder-quobyte-15452774-3e06-4d30-935c-23f1cf93b430" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Lock "cinder-quobyte-15452774-3e06-4d30-935c-23f1cf93b430" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea683d16-65f9-4c24-84f4-58be15439907]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:09 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 Apr 15 16:17:09 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:09 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430" returned: 0 in 0.439s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:09 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430 Apr 15 16:17:09 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:09 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-15452774-3e06-4d30-935c-23f1cf93b430" returned: 0 in 0.390s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Lock "cinder-quobyte-15452774-3e06-4d30-935c-23f1cf93b430" released by "delete_volume" :: held 0.866s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Created reservations ['bc8cc4da-8924-4e73-af35-66d968ea5684', '9ec3f2cc-c08f-47e9-9ac1-d139ab3b8652', '6db5daea-1dd3-4d43-94f5-ddc299db0e14', 'e2b08325-96f7-4eab-8b56-4288be264c19'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:09 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:09 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Acquiring lock "cinder-e519eb40-8d06-4255-adf5-a38e9dbaeae5-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Lock "cinder-e519eb40-8d06-4255-adf5-a38e9dbaeae5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Acquiring lock "cinder-quobyte-e519eb40-8d06-4255-adf5-a38e9dbaeae5" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Lock "cinder-quobyte-e519eb40-8d06-4255-adf5-a38e9dbaeae5" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa295d-b2f3-417b-b8d1-0505b0f5aa20]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:10 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 Apr 15 16:17:10 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:10 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.406s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Deleted volume successfully. Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6a1192d5-f1cf-4c51-aeab-cd89c5bcbb53 tempest-CinderUnicodeTest-459334178 None] Lock "cinder-15452774-3e06-4d30-935c-23f1cf93b430-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:10 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:10 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5 Apr 15 16:17:10 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:10 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e519eb40-8d06-4255-adf5-a38e9dbaeae5" returned: 0 in 0.392s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Lock "cinder-quobyte-e519eb40-8d06-4255-adf5-a38e9dbaeae5" released by "delete_volume" :: held 0.870s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=118,cinder:INSERT=40,cinder:UPDATE=135,cinder:DELETE=15 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=118,cinder:UPDATE=170,cinder:INSERT=37,cinder:DELETE=11 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:17:10 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Created reservations ['bd6cb0ee-caf9-444b-bbcc-38a22b95a23b', 'fcfa81e6-db7a-43d0-a188-dcbc1f18e816', 'c05a8495-19b6-46c7-b13d-afdcdf951a39', '2551f9c2-bab6-452b-ac20-46cd81653765'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:11 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:11 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:11 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.439s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:11 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Deleted volume successfully. Apr 15 16:17:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ad75f3ec-d730-4277-8021-18c5c5f6cc7a tempest-CinderUnicodeTest-459334178 None] Lock "cinder-e519eb40-8d06-4255-adf5-a38e9dbaeae5-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Flow 'volume_create_manager' (560bae7f-b36d-4e65-a772-f8c16ac008f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5d7ff7-d359-4234-ab39-1b5439b10acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5d7ff7-d359-4234-ab39-1b5439b10acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-732126345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cb4170-b01c-41f3-b181-38e04abf4619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03aa2414756747dcbf3108bb8e7b6880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:18Z,use_quota=True,user_id='48486a0080674b83b52aca366e56a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60f99f9-ea2e-4c4d-a78e-f67f6dca522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60f99f9-ea2e-4c4d-a78e-f67f6dca522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951fa1ce-ca46-4469-81b7-e6d57dc3934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951fa1ce-ca46-4469-81b7-e6d57dc3934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58cb4170-b01c-41f3-b181-38e04abf4619', 'volume_name': 'volume-58cb4170-b01c-41f3-b181-38e04abf4619', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb0a4de-8e55-4bba-8967-a84181bb9f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb0a4de-8e55-4bba-8967-a84181bb9f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249ae9cb-4c7b-4684-881d-85bba3f08d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Volume 58cb4170-b01c-41f3-b181-38e04abf4619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58cb4170-b01c-41f3-b181-38e04abf4619', 'volume_size': 1} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-732126345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cb4170-b01c-41f3-b181-38e04abf4619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03aa2414756747dcbf3108bb8e7b6880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:18Z,use_quota=True,user_id='48486a0080674b83b52aca366e56a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Creating volume 58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:18 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:18 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 1073741824 Apr 15 16:17:18 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (edd27215-74f5-431e-96c4-dc34eb389997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ec2894-820f-4219-83d8-1515f8324597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ec2894-820f-4219-83d8-1515f8324597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1436142389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d5e70c-f5b1-457f-a351-8856ce1a4d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:18Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb0b57c-1003-450d-ab50-0afffdef42b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb0b57c-1003-450d-ab50-0afffdef42b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f039b272-62af-4e55-85be-d6c8474cbc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f039b272-62af-4e55-85be-d6c8474cbc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d5e70c-f5b1-457f-a351-8856ce1a4d46', 'volume_name': 'volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849497a1-ff73-46dc-b377-f12cc55f25e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849497a1-ff73-46dc-b377-f12cc55f25e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0164c7-16b5-4fd3-b691-7bd8d9438181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume 18d5e70c-f5b1-457f-a351-8856ce1a4d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46', 'volume_size': 1} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (cb3a9ed1-3738-4278-8edc-c97c52596f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27a0b2e-5b7f-4f68-945a-d8c954833165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27a0b2e-5b7f-4f68-945a-d8c954833165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-763227375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd11ab3-dbb2-47af-a359-06ab3d8c8845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:18Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66bf01d-79ac-42ed-bb67-45a9eac38695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66bf01d-79ac-42ed-bb67-45a9eac38695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49057deb-eb27-4ecc-9e0a-51a57a7ce5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49057deb-eb27-4ecc-9e0a-51a57a7ce5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd11ab3-dbb2-47af-a359-06ab3d8c8845', 'volume_name': 'volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff0e019-d243-4a75-bf47-718456a7258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff0e019-d243-4a75-bf47-718456a7258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e92349-6133-4e27-b736-a9ed7d49c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Volume 3bd11ab3-dbb2-47af-a359-06ab3d8c8845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845', 'volume_size': 1} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (0d4b0194-87ca-4bc3-8ba2-1e270ee913e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917d3722-c4af-4f26-bed2-bd94a258c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917d3722-c4af-4f26-bed2-bd94a258c33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663614891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f30fa6-c635-4fb9-bab9-2fcf40eb2109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:19Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f35058c-8a69-4789-8877-c8029da3e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f35058c-8a69-4789-8877-c8029da3e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cf4b06-9c71-42e1-8475-7dff5f858d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cf4b06-9c71-42e1-8475-7dff5f858d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f30fa6-c635-4fb9-bab9-2fcf40eb2109', 'volume_name': 'volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4f70a5-f0ae-4987-988c-e94bcc0fa5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4f70a5-f0ae-4987-988c-e94bcc0fa5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7687f6-edac-4e57-a3a1-a0a8bf31cb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Volume 24f30fa6-c635-4fb9-bab9-2fcf40eb2109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109', 'volume_size': 1} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (0dca4499-df82-4a65-af8f-e28795d5af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d9f2cc-3087-4ac4-b39c-5b07b4cafd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d9f2cc-3087-4ac4-b39c-5b07b4cafd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-852400973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee252bc-2780-46c1-a92f-1733b64cf485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:19Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b627cf8d-cfe2-4c13-bbb9-aa141e41ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b627cf8d-cfe2-4c13-bbb9-aa141e41ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08347d3d-e418-4540-972c-b4c371a4c2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08347d3d-e418-4540-972c-b4c371a4c2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee252bc-2780-46c1-a92f-1733b64cf485', 'volume_name': 'volume-9ee252bc-2780-46c1-a92f-1733b64cf485', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b9fb0a-78ca-4229-af59-baef008484d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b9fb0a-78ca-4229-af59-baef008484d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2849a6aa-f828-49e3-aba1-3c635b8851be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:18 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Volume 9ee252bc-2780-46c1-a92f-1733b64cf485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee252bc-2780-46c1-a92f-1733b64cf485', 'volume_size': 1} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:18 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 1073741824" returned: 0 in 0.680s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:18 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 Apr 15 16:17:18 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (22f3991c-0a85-4ec5-8d43-a440695ddd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a40c110-4c15-48d8-a45a-250cecd3e372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a40c110-4c15-48d8-a45a-250cecd3e372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1049717611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f1fac9-82df-48cd-b80e-c78e9660e1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:19Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e222e3f-0151-413c-bebc-b1c81148fa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e222e3f-0151-413c-bebc-b1c81148fa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95707c2-a4ec-4702-9f66-38a3c54e10e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95707c2-a4ec-4702-9f66-38a3c54e10e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f1fac9-82df-48cd-b80e-c78e9660e1ed', 'volume_name': 'volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbb8078-f39b-4b4e-a101-dbe226599bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbb8078-f39b-4b4e-a101-dbe226599bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6fbe6b-1fe6-444a-8b86-820a152be473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Volume 50f1fac9-82df-48cd-b80e-c78e9660e1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed', 'volume_size': 1} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (a01d2e40-f469-4ed3-bfe3-e23085918155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d038f5-53f1-4688-8980-d00cb7cf63da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d038f5-53f1-4688-8980-d00cb7cf63da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2069999260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2176d4-3b93-4c55-bb24-2bae4c1fb255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:19Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0f7175-7679-4896-aeb7-a19b6342852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0f7175-7679-4896-aeb7-a19b6342852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0951f435-be50-428f-b432-b2fc49f63128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0951f435-be50-428f-b432-b2fc49f63128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2176d4-3b93-4c55-bb24-2bae4c1fb255', 'volume_name': 'volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84298811-8fa8-4a1c-a545-2e5650802ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84298811-8fa8-4a1c-a545-2e5650802ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6c5b4c-0f17-4172-b937-7628bfa91b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Volume fd2176d4-3b93-4c55-bb24-2bae4c1fb255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255', 'volume_size': 1} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:19 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619" returned: 0 in 0.503s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1436142389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d5e70c-f5b1-457f-a351-8856ce1a4d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:18Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Creating volume 18d5e70c-f5b1-457f-a351-8856ce1a4d46 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:19 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249ae9cb-4c7b-4684-881d-85bba3f08d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cb4170-b01c-41f3-b181-38e04abf4619', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 1073741824 Apr 15 16:17:19 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44f3dcf-2a70-45d5-89f2-fdb65b7757f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:19 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Volume volume-58cb4170-b01c-41f3-b181-38e04abf4619 (58cb4170-b01c-41f3-b181-38e04abf4619): created successfully Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44f3dcf-2a70-45d5-89f2-fdb65b7757f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Flow 'volume_create_manager' (560bae7f-b36d-4e65-a772-f8c16ac008f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:19 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-bf9b4a84-662a-4b13-bf41-e895db8e1940 tempest-VolumeDependencyTests-153979939 None] Created volume successfully. Apr 15 16:17:19 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 1073741824" returned: 0 in 0.470s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:19 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 Apr 15 16:17:19 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:20 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46" returned: 0 in 0.520s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-763227375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd11ab3-dbb2-47af-a359-06ab3d8c8845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:18Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Creating volume 3bd11ab3-dbb2-47af-a359-06ab3d8c8845 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:20 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0164c7-16b5-4fd3-b691-7bd8d9438181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a8ea1e-5da8-445c-b14b-03044c66b66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:20 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 1073741824 Apr 15 16:17:20 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:20 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 (18d5e70c-f5b1-457f-a351-8856ce1a4d46): created successfully Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a8ea1e-5da8-445c-b14b-03044c66b66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (edd27215-74f5-431e-96c4-dc34eb389997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:20 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b8adc86c-2e1b-4952-94f6-480d0d4e05fd tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created volume successfully. Apr 15 16:17:20 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 1073741824" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:20 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:20 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 Apr 15 16:17:20 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:21 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845" returned: 0 in 0.537s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.790s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663614891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f30fa6-c635-4fb9-bab9-2fcf40eb2109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:19Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Creating volume 24f30fa6-c635-4fb9-bab9-2fcf40eb2109 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:21 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e92349-6133-4e27-b736-a9ed7d49c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82be096f-7b24-45af-925e-8a3fbe3b38ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:21 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 1073741824 Apr 15 16:17:21 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Volume volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 (3bd11ab3-dbb2-47af-a359-06ab3d8c8845): created successfully Apr 15 16:17:21 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82be096f-7b24-45af-925e-8a3fbe3b38ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:21 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (cb3a9ed1-3738-4278-8edc-c97c52596f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:21 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-5afc0619-0e80-4efc-8bbd-b99733655e8f tempest-CreateVolumesFromImageTest-968276962 None] Created volume successfully. Apr 15 16:17:22 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 1073741824" returned: 0 in 0.603s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:22 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 Apr 15 16:17:22 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:22 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.725s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-852400973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee252bc-2780-46c1-a92f-1733b64cf485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:19Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Creating volume 9ee252bc-2780-46c1-a92f-1733b64cf485 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:22 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7687f6-edac-4e57-a3a1-a0a8bf31cb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18076fa-05ad-458f-8fda-860c29c2314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:22 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 1073741824 Apr 15 16:17:22 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:22 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Volume volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 (24f30fa6-c635-4fb9-bab9-2fcf40eb2109): created successfully Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18076fa-05ad-458f-8fda-860c29c2314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:22 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (0d4b0194-87ca-4bc3-8ba2-1e270ee913e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:22 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e37acd0e-0016-430b-9228-9693b89b780f tempest-CreateVolumesFromImageTest-968276962 None] Created volume successfully. Apr 15 16:17:23 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 1073741824" returned: 0 in 0.532s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:23 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 Apr 15 16:17:23 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:23 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485" returned: 0 in 0.533s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.488s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1049717611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f1fac9-82df-48cd-b80e-c78e9660e1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:19Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Creating volume 50f1fac9-82df-48cd-b80e-c78e9660e1ed {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:23 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2849a6aa-f828-49e3-aba1-3c635b8851be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee252bc-2780-46c1-a92f-1733b64cf485', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3519f02e-c33f-4a0c-92a4-7ef6b8c2f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:23 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed 1073741824 Apr 15 16:17:23 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:23 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Volume volume-9ee252bc-2780-46c1-a92f-1733b64cf485 (9ee252bc-2780-46c1-a92f-1733b64cf485): created successfully Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3519f02e-c33f-4a0c-92a4-7ef6b8c2f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:23 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (0dca4499-df82-4a65-af8f-e28795d5af92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:23 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-007234c8-ebce-4d6e-a278-0a7bd62e1001 tempest-CreateVolumesFromImageTest-968276962 None] Created volume successfully. Apr 15 16:17:24 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed 1073741824" returned: 0 in 0.574s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:24 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed Apr 15 16:17:24 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:24 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed" returned: 0 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.376s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2069999260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2176d4-3b93-4c55-bb24-2bae4c1fb255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c292818f844f83b3dab45ea7b24463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:19Z,use_quota=True,user_id='9225fd6c41be427f81544fd2708a09c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Creating volume fd2176d4-3b93-4c55-bb24-2bae4c1fb255 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:24 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6fbe6b-1fe6-444a-8b86-820a152be473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c929038-8c74-42b9-aa03-a32f596f09dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:24 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 1073741824 Apr 15 16:17:24 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:24 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Volume volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed (50f1fac9-82df-48cd-b80e-c78e9660e1ed): created successfully Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c929038-8c74-42b9-aa03-a32f596f09dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:24 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (22f3991c-0a85-4ec5-8d43-a440695ddd8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:24 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ee8a4bcf-375b-4770-8d1e-7672699fa5fe tempest-CreateVolumesFromImageTest-968276962 None] Created volume successfully. Apr 15 16:17:25 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 1073741824" returned: 0 in 0.485s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:25 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 Apr 15 16:17:25 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:25 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255" returned: 0 in 0.433s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.316s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6c5b4c-0f17-4172-b937-7628bfa91b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dee6134-d5e0-4672-a38a-497ecbb70ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:25 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Volume volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 (fd2176d4-3b93-4c55-bb24-2bae4c1fb255): created successfully Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dee6134-d5e0-4672-a38a-497ecbb70ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Flow 'volume_create_manager' (a01d2e40-f469-4ed3-bfe3-e23085918155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Creating offline snapshot c28e438f-9772-43fa-b532-61cecc1d6c09 of volume 58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:17:25 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-219b1c9a-a508-4b11-8f7b-f14b2a5c14d6 tempest-CreateVolumesFromImageTest-968276962 None] Created volume successfully. Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dc662d-1dd5-4e6e-8e06-66fe843a7364]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:25 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 Apr 15 16:17:25 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-fd2176d4-3b93-4c55-bb24-2bae4c1fb255-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-fd2176d4-3b93-4c55-bb24-2bae4c1fb255-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-quobyte-fd2176d4-3b93-4c55-bb24-2bae4c1fb255" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-fd2176d4-3b93-4c55-bb24-2bae4c1fb255" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[779bc606-7c7f-4be0-a32c-1001a66dfd10]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:25 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:26 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 Apr 15 16:17:26 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:26 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619" returned: 0 in 0.516s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:26 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 1G Apr 15 16:17:26 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:26 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255" returned: 0 in 0.482s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:26 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255 Apr 15 16:17:26 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:26 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 1G" returned: 0 in 0.565s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cb4170-b01c-41f3-b181-38e04abf4619 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:26 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cb4170-b01c-41f3-b181-38e04abf4619 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 Apr 15 16:17:26 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:26 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:26 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-fd2176d4-3b93-4c55-bb24-2bae4c1fb255" returned: 0 in 0.526s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-fd2176d4-3b93-4c55-bb24-2bae4c1fb255" released by "delete_volume" :: held 1.029s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Created reservations ['d3569e37-2059-46e0-a229-c4ee8eaaa550', 'd266bdff-c1c5-44c8-8fae-cbb5b8e19892', '9bfadbfc-ea65-460b-a4b5-9c4b80ceeb49', '426a7ead-1e5a-4b1c-984e-e754cb929f53'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:27 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:27 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:27 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58cb4170-b01c-41f3-b181-38e04abf4619 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:27 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 is being set with open permissions: ugo+rw Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:27 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 Apr 15 16:17:27 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:27 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.442s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:27 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Deleted volume successfully. Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-e88dc66c-817f-4ef6-8ff2-4eed1b2e99d3 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-fd2176d4-3b93-4c55-bb24-2bae4c1fb255-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:27 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09" returned: 0 in 0.435s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:27 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:27 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.info Apr 15 16:17:27 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-50f1fac9-82df-48cd-b80e-c78e9660e1ed-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-50f1fac9-82df-48cd-b80e-c78e9660e1ed-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-quobyte-50f1fac9-82df-48cd-b80e-c78e9660e1ed" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-50f1fac9-82df-48cd-b80e-c78e9660e1ed" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d25fc7-9ece-49e4-a89a-d9a9e3ceec9d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:28 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.info" returned: 0 in 0.464s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:28 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.info is being set with open permissions: ugo+rw Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:28 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.info Apr 15 16:17:28 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:28 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed Apr 15 16:17:28 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:28 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.info" returned: 0 in 0.469s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.983s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.269s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Creating offline snapshot d5de4413-6521-4867-9b0f-0aa9976f461c of volume 18d5e70c-f5b1-457f-a351-8856ce1a4d46 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:17:28 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-d09dad6b-8e53-4c14-9df1-95092e35c2b8 tempest-VolumeDependencyTests-153979939 None] Create snapshot completed successfully Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[964bf2b4-cf28-411e-9633-84a3661d3be1]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:28 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed" returned: 0 in 0.561s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:28 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:28 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed Apr 15 16:17:28 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:28 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 Apr 15 16:17:28 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:29 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-50f1fac9-82df-48cd-b80e-c78e9660e1ed" returned: 0 in 0.469s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-50f1fac9-82df-48cd-b80e-c78e9660e1ed" released by "delete_volume" :: held 1.059s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:29 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46" returned: 0 in 0.532s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Created reservations ['f9dceae0-e7d9-474d-9064-dc4fa13aa43b', '5d7b4c08-d0b4-4a4d-9016-e4db4fba0c96', 'f8b65b10-db04-4295-9791-22dbbd400b51', '17cd1efa-2268-45a8-8a72-af9e828f942b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:29 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c 1G Apr 15 16:17:29 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:29 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:29 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:29 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c 1G" returned: 0 in 0.569s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:29 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c Apr 15 16:17:29 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:29 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.610s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:29 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Deleted volume successfully. Apr 15 16:17:29 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-1c2aedfe-ce24-4a0a-b393-333761a7e688 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-50f1fac9-82df-48cd-b80e-c78e9660e1ed-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Flow 'volume_create_manager' (17aaab02-4efd-4940-beb5-0a1eee317657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aca2100-e9a6-418f-b648-4d5a6aadd552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aca2100-e9a6-418f-b648-4d5a6aadd552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1131490229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533b6428-06c5-4e5f-b82a-3f465a4e8945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03aa2414756747dcbf3108bb8e7b6880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c28e438f-9772-43fa-b532-61cecc1d6c09,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:30Z,use_quota=True,user_id='48486a0080674b83b52aca366e56a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9db9a0-7efb-4a6e-b08f-82397b795874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9db9a0-7efb-4a6e-b08f-82397b795874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6856e1d-b4e3-4c9a-8e53-af0269834342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6856e1d-b4e3-4c9a-8e53-af0269834342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '533b6428-06c5-4e5f-b82a-3f465a4e8945', 'volume_name': 'volume-533b6428-06c5-4e5f-b82a-3f465a4e8945', 'volume_size': 1, 'snapshot_id': 'c28e438f-9772-43fa-b532-61cecc1d6c09'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c669812c-984e-451e-87ab-70d24b1ad54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c669812c-984e-451e-87ab-70d24b1ad54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5b7564-98cc-41d2-be21-e719f1193c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:30 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Volume 533b6428-06c5-4e5f-b82a-3f465a4e8945: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-533b6428-06c5-4e5f-b82a-3f465a4e8945', 'volume_size': 1, 'snapshot_id': 'c28e438f-9772-43fa-b532-61cecc1d6c09'} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-9ee252bc-2780-46c1-a92f-1733b64cf485-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-9ee252bc-2780-46c1-a92f-1733b64cf485-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-quobyte-9ee252bc-2780-46c1-a92f-1733b64cf485" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-9ee252bc-2780-46c1-a92f-1733b64cf485" acquired by "delete_volume" :: waited 0.018s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[553bcc22-738b-4b71-9c97-94d9cfea8884]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:30 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:30 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c" returned: 0 in 0.665s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:30 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:30 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c is being set with open permissions: ugo+rw Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:30 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c Apr 15 16:17:30 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:30 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485" returned: 0 in 0.533s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:30 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:30 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485 Apr 15 16:17:30 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:31 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c" returned: 0 in 0.521s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:31 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.info Apr 15 16:17:31 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:31 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.info" returned: 0 in 0.473s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:31 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.info is being set with open permissions: ugo+rw Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:31 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9ee252bc-2780-46c1-a92f-1733b64cf485" returned: 0 in 0.607s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-9ee252bc-2780-46c1-a92f-1733b64cf485" released by "delete_volume" :: held 1.172s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:31 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.info Apr 15 16:17:31 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Created reservations ['8cef2716-5f87-46b1-adbd-5b2d5057ba6e', '61aefa4d-0b07-45c5-8b9e-3642ea165cac', 'e308a972-54e2-4639-894a-7b362602c144', '71774204-2869-440a-92de-9746fa6d6273'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:31 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:31 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:31 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Flow 'volume_create_manager' (2b712786-b22b-453e-b86e-c733563fafcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6b2875-deb7-4076-8cd1-418d37428f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6b2875-deb7-4076-8cd1-418d37428f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1490869765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d041b87e-48a0-4d91-9b09-bd7fe17a6ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e672b3833e8440f1b8681049b4cab5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:32Z,use_quota=True,user_id='eb4183bde169436c91cb98bfdf7a467c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485c1b4d-6ab8-46b7-a4fe-4135cc6cd1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485c1b4d-6ab8-46b7-a4fe-4135cc6cd1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c10784-9d0d-48eb-8434-d83a14b87f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c10784-9d0d-48eb-8434-d83a14b87f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd041b87e-48a0-4d91-9b09-bd7fe17a6ca9', 'volume_name': 'volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a31ebcc-e7b1-465a-932e-f345984fd7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a31ebcc-e7b1-465a-932e-f345984fd7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816160ff-6e0e-4cb8-968b-ea2c11fd671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:32 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Volume d041b87e-48a0-4d91-9b09-bd7fe17a6ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9', 'volume_size': 1} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:32 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.info" returned: 0 in 0.583s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:32 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.437s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.037s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-c28e438f-9772-43fa-b532-61cecc1d6c09-533b6428-06c5-4e5f-b82a-3f465a4e8945" by "_create_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:32 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Deleted volume successfully. Apr 15 16:17:32 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-49bf05e6-1454-411f-9b9c-6a80f0b964a3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Create snapshot completed successfully Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-c28e438f-9772-43fa-b532-61cecc1d6c09-533b6428-06c5-4e5f-b82a-3f465a4e8945" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Creating volume 533b6428-06c5-4e5f-b82a-3f465a4e8945 from snapshot c28e438f-9772-43fa-b532-61cecc1d6c09 {{(pid=82392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-533b6428-06c5-4e5f-b82a-3f465a4e8945" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-51131041-bb3d-4166-b886-7d1dcf206632 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-9ee252bc-2780-46c1-a92f-1733b64cf485-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-533b6428-06c5-4e5f-b82a-3f465a4e8945" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] snapshot: c28e438f-9772-43fa-b532-61cecc1d6c09, volume: 533b6428-06c5-4e5f-b82a-3f465a4e8945, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e37dced-2d73-4aaf-a3a1-13b32b8e045f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:32 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 Apr 15 16:17:32 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-24f30fa6-c635-4fb9-bab9-2fcf40eb2109-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-24f30fa6-c635-4fb9-bab9-2fcf40eb2109-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-quobyte-24f30fa6-c635-4fb9-bab9-2fcf40eb2109" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-24f30fa6-c635-4fb9-bab9-2fcf40eb2109" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ee280e-a4d8-4cb8-b548-94c81ecadcb8]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:32 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 Apr 15 16:17:32 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:32 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cb4170-b01c-41f3-b181-38e04abf4619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b886f1a-2845-4bb3-8eae-b008dd76af78]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:32 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 Apr 15 16:17:32 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (72664b07-d1e3-43a8-b97d-9f04bcb5894b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:32 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfaf899-378b-4701-b5e6-bfe9b0fd8fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfaf899-378b-4701-b5e6-bfe9b0fd8fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1740322207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7331cc-a50f-434e-89c5-9cdf63454e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:33Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5990808-142f-4a54-bd6a-df4473ddfc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5990808-142f-4a54-bd6a-df4473ddfc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f62cca1-b599-4056-96ea-e16f88a881ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f62cca1-b599-4056-96ea-e16f88a881ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7331cc-a50f-434e-89c5-9cdf63454e7d', 'volume_name': 'volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d781ab-b2ad-4c32-b010-4055b87c06a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d781ab-b2ad-4c32-b010-4055b87c06a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf62c2b-20ea-41d4-989f-2418c30083a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume 7d7331cc-a50f-434e-89c5-9cdf63454e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d', 'volume_size': 1} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:33 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (a51a2f90-1032-469f-a2c4-f02e1151847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9575bd0-9e0e-4d37-8d3f-89910b83f8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109" returned: 0 in 0.648s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9575bd0-9e0e-4d37-8d3f-89910b83f8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1712376150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cf30b2-4443-4568-bf31-86cac3bf79d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:33Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3e614b-e526-41c9-80cc-e93e19b10eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3e614b-e526-41c9-80cc-e93e19b10eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ddd216-2f31-472c-b505-37a3227b5840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ddd216-2f31-472c-b505-37a3227b5840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cf30b2-4443-4568-bf31-86cac3bf79d8', 'volume_name': 'volume-10cf30b2-4443-4568-bf31-86cac3bf79d8', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bb61ee-ef3b-4938-8a90-ba20d263527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bb61ee-ef3b-4938-8a90-ba20d263527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109 Apr 15 16:17:33 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad46572e-9dc8-4811-8436-322846c856d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume 10cf30b2-4443-4568-bf31-86cac3bf79d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cf30b2-4443-4568-bf31-86cac3bf79d8', 'volume_size': 1} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:33 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619" returned: 0 in 0.602s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:33 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 Apr 15 16:17:33 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (d4e7041f-eb2f-4302-950b-a97246c9e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4d4bcd-8ff1-4229-b2d0-1190a2d0a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4d4bcd-8ff1-4229-b2d0-1190a2d0a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657450613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef531aed-25e9-4e62-962d-277b7660253b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:33Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193e61d7-674f-4c23-8c2a-b3f61a3e5f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193e61d7-674f-4c23-8c2a-b3f61a3e5f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cf1c47-f358-4cd2-ba77-395d5acfb8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cf1c47-f358-4cd2-ba77-395d5acfb8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef531aed-25e9-4e62-962d-277b7660253b', 'volume_name': 'volume-ef531aed-25e9-4e62-962d-277b7660253b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64705efd-c3f4-42dd-aed9-554944265843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64705efd-c3f4-42dd-aed9-554944265843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d825acf-bd8f-45f6-9645-723a88bf7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume ef531aed-25e9-4e62-962d-277b7660253b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef531aed-25e9-4e62-962d-277b7660253b', 'volume_size': 1} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (d5ac367b-327a-4e6c-89c9-66b3b78f4d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d241990-f75a-439f-9cad-c66db41da54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d241990-f75a-439f-9cad-c66db41da54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101325352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01af8e6e-0e85-4ffc-bc9e-943c22e67af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:34Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91c5a7a-4c65-4b45-a9af-df0cff10033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91c5a7a-4c65-4b45-a9af-df0cff10033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a8c1f2-7f26-40e6-8ee8-4226a6d19781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a8c1f2-7f26-40e6-8ee8-4226a6d19781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01af8e6e-0e85-4ffc-bc9e-943c22e67af8', 'volume_name': 'volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807c2ddc-c2aa-42ad-8ae7-ea3645c7ac1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807c2ddc-c2aa-42ad-8ae7-ea3645c7ac1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cbffb7-b45e-467f-82b1-1127e4a4ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume 01af8e6e-0e85-4ffc-bc9e-943c22e67af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8', 'volume_size': 1} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-24f30fa6-c635-4fb9-bab9-2fcf40eb2109" returned: 0 in 0.550s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-24f30fa6-c635-4fb9-bab9-2fcf40eb2109" released by "delete_volume" :: held 1.227s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (24188948-1bdd-4ec7-8eea-2afeed6d6906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248818f4-bcfa-4433-9cd5-47125f5fb2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248818f4-bcfa-4433-9cd5-47125f5fb2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101156867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbb345e-82fd-4526-998f-2d598de5c857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:34Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2cbaa7-d9c0-4320-8759-1991d2b1fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2cbaa7-d9c0-4320-8759-1991d2b1fd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdadfd2-4eb1-43af-b88d-d061a24223c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdadfd2-4eb1-43af-b88d-d061a24223c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cbb345e-82fd-4526-998f-2d598de5c857', 'volume_name': 'volume-0cbb345e-82fd-4526-998f-2d598de5c857', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406b2544-6179-47e1-ae04-d2988d104574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406b2544-6179-47e1-ae04-d2988d104574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb3418a-fc2a-4ab1-896b-e58c23792db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:33 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume 0cbb345e-82fd-4526-998f-2d598de5c857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cbb345e-82fd-4526-998f-2d598de5c857', 'volume_size': 1} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:33 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Created reservations ['373aa99f-09fb-4eb2-9fc5-7c73d2332c51', '14be6460-5d81-4a65-8bd0-8a0fc052264b', '57b370d8-a36c-4dff-98a7-a950df1c4ba4', '7638bfb9-ce92-4630-a11a-f50d3bd30205'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:34 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:34 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-3bd11ab3-dbb2-47af-a359-06ab3d8c8845-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-3bd11ab3-dbb2-47af-a359-06ab3d8c8845-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "cinder-quobyte-3bd11ab3-dbb2-47af-a359-06ab3d8c8845" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-3bd11ab3-dbb2-47af-a359-06ab3d8c8845" acquired by "delete_volume" :: waited 0.058s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1235fd-e0cc-44ee-8294-b4073422cfba]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:34 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:35 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.200s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:35 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:35 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Deleted volume successfully. Apr 15 16:17:35 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-986a945f-5fd1-4494-b924-4dec6a305cc0 tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-24f30fa6-c635-4fb9-bab9-2fcf40eb2109-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:35 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 Apr 15 16:17:35 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:35 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945" returned: 0 in 2.359s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:35 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[db466585-239f-479f-92d3-d5b709ef97ad]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:35 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 Apr 15 16:17:35 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:35 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845" returned: 0 in 0.946s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:35 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:35 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845 Apr 15 16:17:35 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:36 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619" returned: 0 in 0.598s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:17:36 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Converted 1024.00 MB image at 434.01 MB/s Apr 15 16:17:36 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 is being set with open permissions: ugo+rw Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:36 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 Apr 15 16:17:36 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:36 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3bd11ab3-dbb2-47af-a359-06ab3d8c8845" returned: 0 in 0.493s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-quobyte-3bd11ab3-dbb2-47af-a359-06ab3d8c8845" released by "delete_volume" :: held 1.484s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Created reservations ['6a319654-c212-48eb-8587-ac7cd447d83f', '060489f4-c3a1-42e1-b5bb-4606050a8b2c', '2decc56a-32be-4787-bfc0-0dca83049f7a', 'c5db3d68-51ee-4373-8788-e945ec6ed2fc'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:36 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:36 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:36 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945" returned: 0 in 0.419s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-533b6428-06c5-4e5f-b82a-3f465a4e8945" released by "_copy_volume_from_snapshot" :: held 4.496s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-c28e438f-9772-43fa-b532-61cecc1d6c09-533b6428-06c5-4e5f-b82a-3f465a4e8945" released by "_create_volume_from_snapshot" :: held 4.520s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.546s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.635s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1490869765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d041b87e-48a0-4d91-9b09-bd7fe17a6ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e672b3833e8440f1b8681049b4cab5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:32Z,use_quota=True,user_id='eb4183bde169436c91cb98bfdf7a467c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Creating volume d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:36 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:36 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 1073741824 Apr 15 16:17:36 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5b7564-98cc-41d2-be21-e719f1193c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533b6428-06c5-4e5f-b82a-3f465a4e8945', 'volume_size': 1, 'snapshot_id': 'c28e438f-9772-43fa-b532-61cecc1d6c09'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5bb08d-1ec8-4e2d-bdd1-f558404c3c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:36 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Volume volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 (533b6428-06c5-4e5f-b82a-3f465a4e8945): created successfully Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5bb08d-1ec8-4e2d-bdd1-f558404c3c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Flow 'volume_create_manager' (17aaab02-4efd-4940-beb5-0a1eee317657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:36 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2efa85e9-328f-4ef7-83d5-3e81f82e1596 tempest-VolumeDependencyTests-153979939 None] Created volume successfully. Apr 15 16:17:36 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.459s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:36 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Deleted volume successfully. Apr 15 16:17:36 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-3d83ac17-3edd-4026-a87d-59fe9510b75b tempest-CreateVolumesFromImageTest-968276962 None] Lock "cinder-3bd11ab3-dbb2-47af-a359-06ab3d8c8845-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:37 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 1073741824" returned: 0 in 0.572s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:37 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 Apr 15 16:17:37 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-c28e438f-9772-43fa-b532-61cecc1d6c09-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Lock "cinder-c28e438f-9772-43fa-b532-61cecc1d6c09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-58cb4170-b01c-41f3-b181-38e04abf4619" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-58cb4170-b01c-41f3-b181-38e04abf4619" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-c28e438f-9772-43fa-b532-61cecc1d6c09" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-c28e438f-9772-43fa-b532-61cecc1d6c09" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Deleting offline snapshot c28e438f-9772-43fa-b532-61cecc1d6c09 of volume 58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] snapshot_file for this snap is: volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed1f86-2cb0-499c-91f2-e6d5fc6ae0de]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:37 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 Apr 15 16:17:37 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:37 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" returned: 0 in 0.544s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.799s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1740322207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7331cc-a50f-434e-89c5-9cdf63454e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:33Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Creating volume 7d7331cc-a50f-434e-89c5-9cdf63454e7d {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:37 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816160ff-6e0e-4cb8-968b-ea2c11fd671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7951d3-33ea-46cb-986c-9de937db93ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:37 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d 1073741824 Apr 15 16:17:37 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:37 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Volume volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 (d041b87e-48a0-4d91-9b09-bd7fe17a6ca9): created successfully Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7951d3-33ea-46cb-986c-9de937db93ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:37 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Flow 'volume_create_manager' (2b712786-b22b-453e-b86e-c733563fafcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:37 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-13e4cc92-1471-405a-84ea-e325b10b895a tempest-SnapshotDependencyTests-1431119280 None] Created volume successfully. Apr 15 16:17:38 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09" returned: 0 in 0.575s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58cb4170-b01c-41f3-b181-38e04abf4619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fbd7bf-abd9-4787-b310-1f5576d017d6]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:38 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 Apr 15 16:17:38 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:38 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d 1073741824" returned: 0 in 0.656s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:38 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d Apr 15 16:17:38 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:38 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619" returned: 0 in 0.632s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:38 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:38 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 Apr 15 16:17:38 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:39 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d" returned: 0 in 0.568s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.854s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1712376150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cf30b2-4443-4568-bf31-86cac3bf79d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:33Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Creating volume 10cf30b2-4443-4568-bf31-86cac3bf79d8 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:39 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf62c2b-20ea-41d4-989f-2418c30083a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ed6431-aba4-408c-a0b4-10eed693ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:39 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d (7d7331cc-a50f-434e-89c5-9cdf63454e7d): created successfully Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ed6431-aba4-408c-a0b4-10eed693ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:39 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 1073741824 Apr 15 16:17:39 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (72664b07-d1e3-43a8-b97d-9f04bcb5894b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:39 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-087790c4-1173-47f0-b931-52e56fccac03 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created volume successfully. Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (b73e50af-cef7-4cc3-9f54-78d67d10346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8838a73b-a9d4-4041-9d36-cb9e9fcf4f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8838a73b-a9d4-4041-9d36-cb9e9fcf4f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359499523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10eb9a3-a04b-4eb5-808b-50b9d1a22584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:39Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a71b14-463b-4ba9-95f3-9ee1e8ea8f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a71b14-463b-4ba9-95f3-9ee1e8ea8f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22514e3a-253a-422a-909a-62b8436b4621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22514e3a-253a-422a-909a-62b8436b4621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10eb9a3-a04b-4eb5-808b-50b9d1a22584', 'volume_name': 'volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c327097f-1646-4952-a222-23862e22e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c327097f-1646-4952-a222-23862e22e340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4ff70c-2df7-4d5d-99d0-f28732dd6af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:39 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume e10eb9a3-a04b-4eb5-808b-50b9d1a22584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584', 'volume_size': 1} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:39 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09" returned: 0 in 0.530s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:39 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09 Apr 15 16:17:39 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:39 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 1073741824" returned: 0 in 0.489s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:39 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 Apr 15 16:17:39 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:39 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619.c28e438f-9772-43fa-b532-61cecc1d6c09" returned: 0 in 0.465s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-c28e438f-9772-43fa-b532-61cecc1d6c09" released by "_delete_snapshot" :: held 2.261s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-58cb4170-b01c-41f3-b181-38e04abf4619" released by "delete_snapshot" :: held 2.277s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Created reservations ['ca0e1b66-ec11-4a3a-bfe6-862a86810cb1', '21098e52-bdfe-494d-9a42-cd8cb0b28c42', '8c000bfc-0a5f-4539-b59a-c89c56c72b93', '8b5581d2-5102-46b7-8194-c33f78733cd3'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:39 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Delete snapshot completed successfully. Apr 15 16:17:39 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b76f3289-7e4b-4d27-84cf-e4701375703a tempest-VolumeDependencyTests-153979939 None] Lock "cinder-c28e438f-9772-43fa-b532-61cecc1d6c09-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:40 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.716s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657450613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef531aed-25e9-4e62-962d-277b7660253b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:33Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Creating volume ef531aed-25e9-4e62-962d-277b7660253b {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:40 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad46572e-9dc8-4811-8436-322846c856d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cf30b2-4443-4568-bf31-86cac3bf79d8', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98aff0a3-0f10-4491-9ba6-ad235c961508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:40 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b 1073741824 Apr 15 16:17:40 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:40 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 (10cf30b2-4443-4568-bf31-86cac3bf79d8): created successfully Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98aff0a3-0f10-4491-9ba6-ad235c961508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (a51a2f90-1032-469f-a2c4-f02e1151847f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:40 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0dd40e36-3a4c-4ef5-addb-72906d9b381a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created volume successfully. Apr 15 16:17:40 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b 1073741824" returned: 0 in 0.509s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:40 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b Apr 15 16:17:40 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-58cb4170-b01c-41f3-b181-38e04abf4619-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-58cb4170-b01c-41f3-b181-38e04abf4619-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-58cb4170-b01c-41f3-b181-38e04abf4619" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-58cb4170-b01c-41f3-b181-38e04abf4619" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[77792c16-9675-49f7-a9d1-d85ae7fce288]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:40 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:40 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 Apr 15 16:17:40 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:41 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.385s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101325352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01af8e6e-0e85-4ffc-bc9e-943c22e67af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:34Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Creating volume 01af8e6e-0e85-4ffc-bc9e-943c22e67af8 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:41 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d825acf-bd8f-45f6-9645-723a88bf7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef531aed-25e9-4e62-962d-277b7660253b', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2edc5da-5e14-4199-9dbc-e73591dd4a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:41 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 1073741824 Apr 15 16:17:41 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:41 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume volume-ef531aed-25e9-4e62-962d-277b7660253b (ef531aed-25e9-4e62-962d-277b7660253b): created successfully Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2edc5da-5e14-4199-9dbc-e73591dd4a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (d4e7041f-eb2f-4302-950b-a97246c9e082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:41 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ec8bf264-371b-4da7-bfcd-bed8b349c7d3 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created volume successfully. Apr 15 16:17:41 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619" returned: 0 in 0.533s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:41 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619 Apr 15 16:17:41 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:41 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 1073741824" returned: 0 in 0.569s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:41 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 Apr 15 16:17:41 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:41 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-58cb4170-b01c-41f3-b181-38e04abf4619" returned: 0 in 0.431s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-58cb4170-b01c-41f3-b181-38e04abf4619" released by "delete_volume" :: held 1.006s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Created reservations ['c3a9a66a-fe9e-4a3d-8269-36e9e1906dc0', 'e3ed3acc-933d-430f-9019-814e63337115', 'a4714208-8326-4a15-894b-965748cb6bec', 'b50f3137-1776-4a58-bb70-f67f25435274'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:41 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:41 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:41 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:42 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8" returned: 0 in 0.424s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.292s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101156867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbb345e-82fd-4526-998f-2d598de5c857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504d31c57e74eecbe0ef804e7fe7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:34Z,use_quota=True,user_id='4e9d0251cc05425daedabafb49274bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Creating volume 0cbb345e-82fd-4526-998f-2d598de5c857 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:42 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cbffb7-b45e-467f-82b1-1127e4a4ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12677492-d7a7-49cf-b504-e54943b89616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:42 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 1073741824 Apr 15 16:17:42 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:42 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 (01af8e6e-0e85-4ffc-bc9e-943c22e67af8): created successfully Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12677492-d7a7-49cf-b504-e54943b89616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (d5ac367b-327a-4e6c-89c9-66b3b78f4d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:42 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0888e4e6-1c48-44e7-a23d-d22d432e4494 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created volume successfully. Apr 15 16:17:42 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:42 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Deleted volume successfully. Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb151e39-006d-4427-9a19-0d5b02997679 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-58cb4170-b01c-41f3-b181-38e04abf4619-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:42 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 1073741824" returned: 0 in 0.523s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:42 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:42 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 Apr 15 16:17:42 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Flow 'volume_create_manager' (8592be42-16cd-43b2-af02-07f7147d6385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9750826f-1d80-4331-9ecc-812df19d617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:43 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857" returned: 0 in 0.467s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9750826f-1d80-4331-9ecc-812df19d617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-607889496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87923b1-13f2-48e9-aa3b-c5fc0a0f6203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03aa2414756747dcbf3108bb8e7b6880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:43Z,use_quota=True,user_id='48486a0080674b83b52aca366e56a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7530c4d-8df0-4f33-aa56-b37b9df490d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7530c4d-8df0-4f33-aa56-b37b9df490d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ab4f2e-0965-4365-bfc7-d84c7f6a8bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ab4f2e-0965-4365-bfc7-d84c7f6a8bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b87923b1-13f2-48e9-aa3b-c5fc0a0f6203', 'volume_name': 'volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a4e810-ca33-4b15-afa7-4a1c18f6aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a4e810-ca33-4b15-afa7-4a1c18f6aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c5d294-64fe-46de-a16e-c7c817b03960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:43 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Volume b87923b1-13f2-48e9-aa3b-c5fc0a0f6203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203', 'volume_size': 1} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.587s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb3418a-fc2a-4ab1-896b-e58c23792db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cbb345e-82fd-4526-998f-2d598de5c857', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6912a304-7e63-45dc-bc95-4fdb41754409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:43 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Volume volume-0cbb345e-82fd-4526-998f-2d598de5c857 (0cbb345e-82fd-4526-998f-2d598de5c857): created successfully Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6912a304-7e63-45dc-bc95-4fdb41754409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Flow 'volume_create_manager' (24188948-1bdd-4ec7-8eea-2afeed6d6906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Creating offline snapshot 417bab6d-ba6b-43b0-9855-149d01611c1c of volume d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:17:43 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c9b6a499-fc72-4150-8ef8-8ff534d8d6fb tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created volume successfully. Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e99ed7-be37-48a9-9bd7-de7a6ccfae79]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:43 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 Apr 15 16:17:43 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-0cbb345e-82fd-4526-998f-2d598de5c857-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-0cbb345e-82fd-4526-998f-2d598de5c857-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-quobyte-0cbb345e-82fd-4526-998f-2d598de5c857" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-0cbb345e-82fd-4526-998f-2d598de5c857" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e0806-3243-4b6f-a2d2-3b223c5d6a8a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:43 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 Apr 15 16:17:43 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:43 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" returned: 0 in 0.484s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:43 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:43 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c 1G Apr 15 16:17:43 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:44 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857" returned: 0 in 0.478s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:44 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857 Apr 15 16:17:44 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:44 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c 1G" returned: 0 in 0.547s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:44 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c Apr 15 16:17:44 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:44 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-0cbb345e-82fd-4526-998f-2d598de5c857" returned: 0 in 0.412s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-0cbb345e-82fd-4526-998f-2d598de5c857" released by "delete_volume" :: held 0.921s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created reservations ['60502fd4-4bd6-4d5b-94fa-ffe840eaf846', '96d37285-2bf2-4414-9fdd-a822e80601d5', '1ddd0f6b-83d2-4078-b662-e6a5b97a4fc2', 'e82de350-aed9-4a6c-bcd3-5f016a9c19ea'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:44 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:44 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-01af8e6e-0e85-4ffc-bc9e-943c22e67af8-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-01af8e6e-0e85-4ffc-bc9e-943c22e67af8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-quobyte-01af8e6e-0e85-4ffc-bc9e-943c22e67af8" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-01af8e6e-0e85-4ffc-bc9e-943c22e67af8" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e565f85-d55d-4ff3-b002-7a48462deedc]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:44 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c" returned: 0 in 0.492s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:44 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c is being set with open permissions: ugo+rw Apr 15 16:17:44 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:44 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c Apr 15 16:17:44 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:44 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 Apr 15 16:17:44 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:45 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.485s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:45 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Deleted volume successfully. Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e610c70-58b9-4a46-9ce7-b814287938c5 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-0cbb345e-82fd-4526-998f-2d598de5c857-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:45 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c" returned: 0 in 0.433s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:45 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.info Apr 15 16:17:45 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:45 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8" returned: 0 in 0.520s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:45 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8 Apr 15 16:17:45 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:45 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.info" returned: 0 in 0.396s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:45 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.info is being set with open permissions: ugo+rw Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:45 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.info Apr 15 16:17:45 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:45 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-01af8e6e-0e85-4ffc-bc9e-943c22e67af8" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-01af8e6e-0e85-4ffc-bc9e-943c22e67af8" released by "delete_volume" :: held 1.023s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created reservations ['5e599f9e-077d-4803-89ef-e28e7af8b695', '1d59667e-766e-42c2-bec6-25dae255fb84', '77c43931-feb4-462a-96ef-03a581b0da9b', 'e36398d8-f660-4554-b0f5-db624d28f53f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:45 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:45 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:45 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:46 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.info" returned: 0 in 0.458s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.888s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.845s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359499523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10eb9a3-a04b-4eb5-808b-50b9d1a22584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:39Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Creating volume e10eb9a3-a04b-4eb5-808b-50b9d1a22584 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:46 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-624b902b-62a4-4e0f-89cd-94a187ebd945 tempest-SnapshotDependencyTests-1431119280 None] Create snapshot completed successfully Apr 15 16:17:46 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 1073741824 Apr 15 16:17:46 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:46 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.408s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:46 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Deleted volume successfully. Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-2e43ee23-5fd0-40fe-ad32-67026f6c8f06 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-01af8e6e-0e85-4ffc-bc9e-943c22e67af8-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:46 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 1073741824" returned: 0 in 0.539s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:46 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 Apr 15 16:17:46 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-ef531aed-25e9-4e62-962d-277b7660253b-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-ef531aed-25e9-4e62-962d-277b7660253b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-quobyte-ef531aed-25e9-4e62-962d-277b7660253b" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-ef531aed-25e9-4e62-962d-277b7660253b" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce0835d-09b3-4ced-8eba-630bc31f236f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:46 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:47 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b Apr 15 16:17:47 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:47 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584" returned: 0 in 0.463s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.939s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-607889496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87923b1-13f2-48e9-aa3b-c5fc0a0f6203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03aa2414756747dcbf3108bb8e7b6880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:43Z,use_quota=True,user_id='48486a0080674b83b52aca366e56a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Creating volume b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:47 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4ff70c-2df7-4d5d-99d0-f28732dd6af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf57b50b-aa2b-4705-bbee-e5e70e979361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 1073741824 Apr 15 16:17:47 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 (e10eb9a3-a04b-4eb5-808b-50b9d1a22584): created successfully Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf57b50b-aa2b-4705-bbee-e5e70e979361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (b73e50af-cef7-4cc3-9f54-78d67d10346e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Flow 'volume_create_manager' (6d9aad40-9ace-44b7-9279-8a4be5acf5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9e89c1-57c4-4c4d-a404-1bd6a43a4667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9e89c1-57c4-4c4d-a404-1bd6a43a4667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59479eb0-e2ef-4c0e-bba7-c94f92117a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e672b3833e8440f1b8681049b4cab5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=417bab6d-ba6b-43b0-9855-149d01611c1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:47Z,use_quota=True,user_id='eb4183bde169436c91cb98bfdf7a467c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8b3c8e-8edd-442a-ae4a-80dfeef1e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8b3c8e-8edd-442a-ae4a-80dfeef1e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b8f07a-3298-407d-bdda-430d747f6d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b8f07a-3298-407d-bdda-430d747f6d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59479eb0-e2ef-4c0e-bba7-c94f92117a39', 'volume_name': 'volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39', 'volume_size': 1, 'snapshot_id': '417bab6d-ba6b-43b0-9855-149d01611c1c'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfa56ab-c51a-4988-b558-b35c43500dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfa56ab-c51a-4988-b558-b35c43500dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c86f9c-a664-49e1-9855-7f2d889da09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Volume 59479eb0-e2ef-4c0e-bba7-c94f92117a39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39', 'volume_size': 1, 'snapshot_id': '417bab6d-ba6b-43b0-9855-149d01611c1c'} Apr 15 16:17:47 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-2591dbce-d525-4972-b74e-ae6fe5661c4d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created volume successfully. Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:47 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b" returned: 0 in 0.530s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:47 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b Apr 15 16:17:47 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:47 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 1073741824" returned: 0 in 0.528s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:47 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 Apr 15 16:17:47 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (10dee025-8123-4bed-b10d-d513b6e0c40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f353f8c-c852-4a89-92df-6b2a6c7bdc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f353f8c-c852-4a89-92df-6b2a6c7bdc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052351508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8ee8e8-9fa5-4878-877c-63d797bb3e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:48Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f19da7-63b5-45b8-92aa-3a2a0da79ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f19da7-63b5-45b8-92aa-3a2a0da79ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f371acb7-93f8-4648-8a92-3fa02cfb7892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f371acb7-93f8-4648-8a92-3fa02cfb7892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8ee8e8-9fa5-4878-877c-63d797bb3e80', 'volume_name': 'volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da63ff64-02b0-4694-96ba-4febe505389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da63ff64-02b0-4694-96ba-4febe505389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b813732c-ea2c-4625-b344-5d49eed1b763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:47 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume 9a8ee8e8-9fa5-4878-877c-63d797bb3e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80', 'volume_size': 1} Apr 15 16:17:47 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:47 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-ef531aed-25e9-4e62-962d-277b7660253b" returned: 0 in 0.509s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-ef531aed-25e9-4e62-962d-277b7660253b" released by "delete_volume" :: held 1.077s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created reservations ['5ffd5486-4339-425c-82ce-5730c04fefb9', '46936c20-5051-4339-928c-7c64dd992c52', 'b7a241c8-e674-47ab-94ad-ee68f4d57d24', 'a3b98f4e-5138-453c-8e67-6e165b34244b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (c0a5f2f5-acc8-47df-8aa8-7fef65118e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29f2e46-faf6-49e4-b85e-4c7c891a2ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29f2e46-faf6-49e4-b85e-4c7c891a2ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011216757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3217ec92-8290-46f6-8805-2d498876509f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:48Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8e4750-6498-419a-bbd9-705b33956bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8e4750-6498-419a-bbd9-705b33956bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b9d285-64b9-4a3b-9c88-4a80013202ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b9d285-64b9-4a3b-9c88-4a80013202ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3217ec92-8290-46f6-8805-2d498876509f', 'volume_name': 'volume-3217ec92-8290-46f6-8805-2d498876509f', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a2ad91-c80a-4074-8f34-66b225996363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a2ad91-c80a-4074-8f34-66b225996363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe2cd60-d236-4f69-8fac-dcf02f7ad092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume 3217ec92-8290-46f6-8805-2d498876509f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3217ec92-8290-46f6-8805-2d498876509f', 'volume_size': 1} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:48 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:48 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:48 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" returned: 0 in 0.462s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.883s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-quobyte-417bab6d-ba6b-43b0-9855-149d01611c1c-59479eb0-e2ef-4c0e-bba7-c94f92117a39" by "_create_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c5d294-64fe-46de-a16e-c7c817b03960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b34e2ef-e3ba-4a0d-b339-a834a87f36e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-417bab6d-ba6b-43b0-9855-149d01611c1c-59479eb0-e2ef-4c0e-bba7-c94f92117a39" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Creating volume 59479eb0-e2ef-4c0e-bba7-c94f92117a39 from snapshot 417bab6d-ba6b-43b0-9855-149d01611c1c {{(pid=82392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-quobyte-59479eb0-e2ef-4c0e-bba7-c94f92117a39" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Volume volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 (b87923b1-13f2-48e9-aa3b-c5fc0a0f6203): created successfully Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b34e2ef-e3ba-4a0d-b339-a834a87f36e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Flow 'volume_create_manager' (8592be42-16cd-43b2-af02-07f7147d6385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0936e957-4d5d-4aa5-a356-0edd32775015 tempest-VolumeDependencyTests-153979939 None] Created volume successfully. Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-59479eb0-e2ef-4c0e-bba7-c94f92117a39" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] snapshot: 417bab6d-ba6b-43b0-9855-149d01611c1c, volume: 59479eb0-e2ef-4c0e-bba7-c94f92117a39, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (e5b8a98c-4e9e-4f69-965d-97ad1d09154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2043177-fe5b-49b2-8808-8ab7060998a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2043177-fe5b-49b2-8808-8ab7060998a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-711522716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7004e4-7cc5-4fcf-ac30-560670fab23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:48Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed3eef3-116a-4e4b-a9db-487a2c51e4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed3eef3-116a-4e4b-a9db-487a2c51e4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd760f8-b1fa-4972-9314-e014187b193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd760f8-b1fa-4972-9314-e014187b193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7004e4-7cc5-4fcf-ac30-560670fab23e', 'volume_name': 'volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4fd907-c1d5-4283-8ed5-cd9f97ec78e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4fd907-c1d5-4283-8ed5-cd9f97ec78e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a322b2-da5d-4c74-8d30-16760079cc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume 4b7004e4-7cc5-4fcf-ac30-560670fab23e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e', 'volume_size': 1} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[82185757-195a-4de8-861b-e851565d923c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:48 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c Apr 15 16:17:48 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (3634ae37-8f5d-4100-8246-13cbb865c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63ad5ca-c33f-46dc-8419-27847c656da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63ad5ca-c33f-46dc-8419-27847c656da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-967635513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337030ab-300a-4b78-9279-a63d16046c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:48Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8294da-77a5-4b16-a8a6-ca82343f3dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8294da-77a5-4b16-a8a6-ca82343f3dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0081a14-4700-4b7b-a1d2-3f59b89627e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0081a14-4700-4b7b-a1d2-3f59b89627e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337030ab-300a-4b78-9279-a63d16046c89', 'volume_name': 'volume-337030ab-300a-4b78-9279-a63d16046c89', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51abb54-5c51-4e67-803d-9d38fbf25cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51abb54-5c51-4e67-803d-9d38fbf25cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0059abd-3ae1-423f-8d09-3f4df54ab563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume 337030ab-300a-4b78-9279-a63d16046c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337030ab-300a-4b78-9279-a63d16046c89', 'volume_size': 1} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:48 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.512s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:48 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Deleted volume successfully. Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6cb09deb-d916-440a-9eff-0045287bd044 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-ef531aed-25e9-4e62-962d-277b7660253b-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (6a99227a-d3f4-4ed8-805d-db84f043de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196e19cc-0b07-4fda-856c-a1290127f3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196e19cc-0b07-4fda-856c-a1290127f3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1179423595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623a8316-9447-4aa8-8df6-7ee17931109c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:49Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ec8f5a-1c3b-460d-a709-edb3b1b75cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ec8f5a-1c3b-460d-a709-edb3b1b75cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28efd14-c7e6-4e14-abe6-6004f8441b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28efd14-c7e6-4e14-abe6-6004f8441b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623a8316-9447-4aa8-8df6-7ee17931109c', 'volume_name': 'volume-623a8316-9447-4aa8-8df6-7ee17931109c', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396d82ef-7e48-46b1-9913-f70329cc62a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396d82ef-7e48-46b1-9913-f70329cc62a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e539b0-b9f1-4cba-8999-9a9945fcd90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume 623a8316-9447-4aa8-8df6-7ee17931109c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623a8316-9447-4aa8-8df6-7ee17931109c', 'volume_size': 1} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Flow 'volume_create_manager' (82998059-a81b-4d67-be95-03041389c155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f39046-c6cd-45d1-b2b2-f9cc29e6aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f39046-c6cd-45d1-b2b2-f9cc29e6aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1771083466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03aa2414756747dcbf3108bb8e7b6880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b87923b1-13f2-48e9-aa3b-c5fc0a0f6203,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:49Z,use_quota=True,user_id='48486a0080674b83b52aca366e56a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc35a84-1235-490f-ab1d-3c15a0e4b13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc35a84-1235-490f-ab1d-3c15a0e4b13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb351a87-e768-4976-9e10-46c283a6a2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb351a87-e768-4976-9e10-46c283a6a2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7', 'volume_name': 'volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7', 'volume_size': 1, 'source_volid': 'b87923b1-13f2-48e9-aa3b-c5fc0a0f6203', 'source_volstatus': 'available'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b20fa84-1547-46cd-9702-511ab53bdcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b20fa84-1547-46cd-9702-511ab53bdcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2305d34-2c97-4408-98e1-1a9f02e60558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:48 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Volume 7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7', 'volume_size': 1, 'source_volid': 'b87923b1-13f2-48e9-aa3b-c5fc0a0f6203', 'source_volstatus': 'available'} Apr 15 16:17:48 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:49 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c" returned: 0 in 0.669s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be0237e-dddd-4f6a-8916-94277de7c889]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-10cf30b2-4443-4568-bf31-86cac3bf79d8-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-10cf30b2-4443-4568-bf31-86cac3bf79d8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-quobyte-10cf30b2-4443-4568-bf31-86cac3bf79d8" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-10cf30b2-4443-4568-bf31-86cac3bf79d8" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93c6b2b-6f98-41cf-aae4-c837955b71c0]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:49 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 Apr 15 16:17:49 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:49 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 Apr 15 16:17:49 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:49 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" returned: 0 in 0.546s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:49 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8" returned: 0 in 0.470s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:49 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:49 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 Apr 15 16:17:49 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:49 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8 Apr 15 16:17:49 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:50 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-10cf30b2-4443-4568-bf31-86cac3bf79d8" returned: 0 in 0.546s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-10cf30b2-4443-4568-bf31-86cac3bf79d8" released by "delete_volume" :: held 1.048s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created reservations ['2855efea-8843-4d4b-8194-5972bd426025', 'c4e567b1-a354-4d88-8634-0cbcd67682d9', 'cdca7e8f-bd59-4105-82d2-6abf1930685e', '05ef438b-b583-4b6a-8ac3-dfad197e53a2'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:50 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:50 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:50 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:51 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 1.070s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:51 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Deleted volume successfully. Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-7d7331cc-a50f-434e-89c5-9cdf63454e7d-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ab1511a3-8843-4314-af66-88b80d99fd64 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-10cf30b2-4443-4568-bf31-86cac3bf79d8-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-7d7331cc-a50f-434e-89c5-9cdf63454e7d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-quobyte-7d7331cc-a50f-434e-89c5-9cdf63454e7d" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-7d7331cc-a50f-434e-89c5-9cdf63454e7d" acquired by "delete_volume" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4488f6-fbba-49cd-92fb-f2a3baaacf1f]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:51 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39" returned: 0 in 2.119s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8817031f-bcff-494d-95a7-c078aba5d011]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:51 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:51 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d Apr 15 16:17:51 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:51 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 Apr 15 16:17:51 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:52 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d" returned: 0 in 0.477s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:52 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d Apr 15 16:17:52 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:52 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" returned: 0 in 0.598s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:17:52 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Converted 1024.00 MB image at 483.04 MB/s Apr 15 16:17:52 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 is being set with open permissions: ugo+rw Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:52 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 Apr 15 16:17:52 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:52 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7d7331cc-a50f-434e-89c5-9cdf63454e7d" returned: 0 in 0.394s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-7d7331cc-a50f-434e-89c5-9cdf63454e7d" released by "delete_volume" :: held 0.896s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created reservations ['cb01bb68-d21c-431d-9594-db0e9a8e5e09', '78d3041e-4984-4d4e-b7c6-f0bce0c048b7', '588d0486-b2c7-4dd1-8561-a262ebbcc8cf', '29357364-7130-4593-a771-9bf151944c47'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:52 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:52 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:52 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39" returned: 0 in 0.478s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-59479eb0-e2ef-4c0e-bba7-c94f92117a39" released by "_copy_volume_from_snapshot" :: held 4.540s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-417bab6d-ba6b-43b0-9855-149d01611c1c-59479eb0-e2ef-4c0e-bba7-c94f92117a39" released by "_create_volume_from_snapshot" :: held 4.580s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.619s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.911s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052351508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8ee8e8-9fa5-4878-877c-63d797bb3e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:48Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Creating volume 9a8ee8e8-9fa5-4878-877c-63d797bb3e80 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:52 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:52 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 1073741824 Apr 15 16:17:52 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c86f9c-a664-49e1-9855-7f2d889da09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39', 'volume_size': 1, 'snapshot_id': '417bab6d-ba6b-43b0-9855-149d01611c1c'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a971eb-b723-4981-a4ed-8a682c76fcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:52 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Volume volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 (59479eb0-e2ef-4c0e-bba7-c94f92117a39): created successfully Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a971eb-b723-4981-a4ed-8a682c76fcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:52 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Flow 'volume_create_manager' (6d9aad40-9ace-44b7-9279-8a4be5acf5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:52 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-6f9ff3bf-428d-4ebe-b163-f6e6ee33393a tempest-SnapshotDependencyTests-1431119280 None] Created volume successfully. Apr 15 16:17:53 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.392s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:53 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Deleted volume successfully. Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-cbbb9324-16f9-48ef-9471-fa13db1f932a tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-7d7331cc-a50f-434e-89c5-9cdf63454e7d-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:53 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 1073741824" returned: 0 in 0.513s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:53 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 Apr 15 16:17:53 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-417bab6d-ba6b-43b0-9855-149d01611c1c-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-d5de4413-6521-4867-9b0f-0aa9976f461c-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-417bab6d-ba6b-43b0-9855-149d01611c1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-quobyte-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-d5de4413-6521-4867-9b0f-0aa9976f461c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-quobyte-18d5e70c-f5b1-457f-a351-8856ce1a4d46" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-quobyte-417bab6d-ba6b-43b0-9855-149d01611c1c" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-18d5e70c-f5b1-457f-a351-8856ce1a4d46" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-quobyte-d5de4413-6521-4867-9b0f-0aa9976f461c" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-417bab6d-ba6b-43b0-9855-149d01611c1c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Deleting offline snapshot 417bab6d-ba6b-43b0-9855-149d01611c1c of volume d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] snapshot_file for this snap is: volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0ddc02-79eb-4c96-80fa-3278514e0124]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-d5de4413-6521-4867-9b0f-0aa9976f461c" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Deleting offline snapshot d5de4413-6521-4867-9b0f-0aa9976f461c of volume 18d5e70c-f5b1-457f-a351-8856ce1a4d46 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] snapshot_file for this snap is: volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[54864539-7ef5-46ce-84d1-462c1aac8c1c]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:53 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80" returned: 0 in 0.461s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:53 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:53 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.706s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011216757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3217ec92-8290-46f6-8805-2d498876509f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:48Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Creating volume 3217ec92-8290-46f6-8805-2d498876509f {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:53 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:53 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c Apr 15 16:17:53 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f 1073741824 Apr 15 16:17:53 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:53 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b813732c-ea2c-4625-b344-5d49eed1b763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbd3048-b992-4aa1-8b7d-e929bf859cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:53 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 (9a8ee8e8-9fa5-4878-877c-63d797bb3e80): created successfully Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbd3048-b992-4aa1-8b7d-e929bf859cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:53 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (10dee025-8123-4bed-b10d-d513b6e0c40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:53 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-7f78e7bd-cffa-4383-ba82-66eb1f3dbcad tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created volume successfully. Apr 15 16:17:54 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c" returned: 0 in 0.483s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb6cbe7-0e1a-4252-b295-42efb1453047]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:54 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c" returned: 0 in 0.481s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8ce3d2-bf1d-4a76-ad8b-1e20352f7961]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:54 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 Apr 15 16:17:54 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:54 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 Apr 15 16:17:54 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:54 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f 1073741824" returned: 0 in 0.594s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:54 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f Apr 15 16:17:54 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:54 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46" returned: 0 in 0.461s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:54 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c Apr 15 16:17:54 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:54 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" returned: 0 in 0.563s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:54 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c Apr 15 16:17:54 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:54 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f" returned: 0 in 0.479s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.585s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-711522716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7004e4-7cc5-4fcf-ac30-560670fab23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:48Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Creating volume 4b7004e4-7cc5-4fcf-ac30-560670fab23e {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:54 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe2cd60-d236-4f69-8fac-dcf02f7ad092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3217ec92-8290-46f6-8805-2d498876509f', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:54 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e 1073741824 Apr 15 16:17:54 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679bfb7b-12c2-4ee8-8801-4531057f2377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:54 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume volume-3217ec92-8290-46f6-8805-2d498876509f (3217ec92-8290-46f6-8805-2d498876509f): created successfully Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679bfb7b-12c2-4ee8-8801-4531057f2377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:54 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (c0a5f2f5-acc8-47df-8aa8-7fef65118e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:55 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-30c67db9-227e-4059-b72a-ca11a81424e1 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created volume successfully. Apr 15 16:17:55 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c" returned: 0 in 0.498s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:55 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c Apr 15 16:17:55 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:55 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c" returned: 0 in 0.514s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:55 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c Apr 15 16:17:55 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:55 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e 1073741824" returned: 0 in 0.558s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:55 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e Apr 15 16:17:55 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:55 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46.d5de4413-6521-4867-9b0f-0aa9976f461c" returned: 0 in 0.412s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-d5de4413-6521-4867-9b0f-0aa9976f461c" released by "_delete_snapshot" :: held 1.911s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-18d5e70c-f5b1-457f-a351-8856ce1a4d46" released by "delete_snapshot" :: held 1.949s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created reservations ['2ebf8eaa-c8d1-4d9b-8f6a-1b638659d567', '40304b9b-13a4-4559-9a2f-dfcdc5831370', 'd47b5af5-61af-450c-a2c8-b66ed318e9d2', '4bc05e1b-cdb5-486d-aba3-b05d9d7ffa65'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:55 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:55 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Delete snapshot completed successfully. Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9.417bab6d-ba6b-43b0-9855-149d01611c1c" returned: 0 in 0.427s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-30667569-d362-4156-916f-060a2d5135ee tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-d5de4413-6521-4867-9b0f-0aa9976f461c-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-417bab6d-ba6b-43b0-9855-149d01611c1c" released by "_delete_snapshot" :: held 2.055s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" released by "delete_snapshot" :: held 2.075s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-18d5e70c-f5b1-457f-a351-8856ce1a4d46-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-18d5e70c-f5b1-457f-a351-8856ce1a4d46-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "cinder-quobyte-18d5e70c-f5b1-457f-a351-8856ce1a4d46" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Created reservations ['dd4c3fa7-0700-466b-8e35-dc4ed9be5403', '272f5a61-d583-44de-82d0-6f1c5b3362e8', 'ace28319-36c6-4896-96d4-1390822b53b0', '357c49b1-037d-44ba-94bb-40b5aeda6b04'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-18d5e70c-f5b1-457f-a351-8856ce1a4d46" acquired by "delete_volume" :: waited 0.022s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f333182c-a6b9-4598-b714-0048efd9e616]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:55 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Delete snapshot completed successfully. Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-7cf85822-bc80-4bf5-b24d-3285f9d7b5d4 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-417bab6d-ba6b-43b0-9855-149d01611c1c-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:55 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e" returned: 0 in 0.438s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.375s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-967635513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337030ab-300a-4b78-9279-a63d16046c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:48Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Creating volume 337030ab-300a-4b78-9279-a63d16046c89 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:55 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:55 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a322b2-da5d-4c74-8d30-16760079cc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:56 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 1073741824 Apr 15 16:17:56 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e81692-f1f1-464a-afce-1269fb98d1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:56 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 Apr 15 16:17:56 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:56 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e (4b7004e4-7cc5-4fcf-ac30-560670fab23e): created successfully Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e81692-f1f1-464a-afce-1269fb98d1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (e5b8a98c-4e9e-4f69-965d-97ad1d09154b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:56 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-4429a049-1c9e-4419-abdd-0a17e97bd3a7 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created volume successfully. Apr 15 16:17:56 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 1073741824" returned: 0 in 0.475s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:56 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46" returned: 0 in 0.523s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:56 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46 Apr 15 16:17:56 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:56 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 Apr 15 16:17:56 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:56 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-quobyte-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-18d5e70c-f5b1-457f-a351-8856ce1a4d46" returned: 0 in 0.422s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-quobyte-18d5e70c-f5b1-457f-a351-8856ce1a4d46" released by "delete_volume" :: held 0.995s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" acquired by "delete_volume" :: waited 0.016s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:56 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89" returned: 0 in 0.448s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe4ba05-3e06-4749-86f4-ae5f65d59663]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.085s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1179423595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623a8316-9447-4aa8-8df6-7ee17931109c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e521c50ec3c0489e938d16468494cb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:17:49Z,use_quota=True,user_id='b926447c230b4155a3ea6b1b2b8c9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Creating volume 623a8316-9447-4aa8-8df6-7ee17931109c {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:17:56 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:56 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c 1073741824 Apr 15 16:17:56 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0059abd-3ae1-423f-8d09-3f4df54ab563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337030ab-300a-4b78-9279-a63d16046c89', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:56 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700b9199-94d1-42bd-a9a6-dbff199418ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:57 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume volume-337030ab-300a-4b78-9279-a63d16046c89 (337030ab-300a-4b78-9279-a63d16046c89): created successfully Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700b9199-94d1-42bd-a9a6-dbff199418ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (3634ae37-8f5d-4100-8246-13cbb865c69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-fd7b88c1-373f-4902-9040-3158292374a5 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created volume successfully. Apr 15 16:17:57 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 Apr 15 16:17:57 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Created reservations ['6f249d52-e797-4ae8-8386-c13abe74de26', 'b550e76c-6cbc-4695-9906-76a82421fc8f', 'b77fa1a7-f783-412a-8728-d9eb9975eb67', '89c8f1d0-e35d-47a1-9be2-596222121132'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:57 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:57 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:57 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" returned: 0 in 0.517s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:57 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c 1073741824" returned: 0 in 0.502s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:57 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9 Apr 15 16:17:57 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:57 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.440s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:57 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Deleted volume successfully. Apr 15 16:17:57 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c Apr 15 16:17:57 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-84a5acfd-8ab8-4f3e-b3a0-b251960a6a97 tempest-CreateVolumesFromSnapshotTest-1312287384 None] Lock "cinder-18d5e70c-f5b1-457f-a351-8856ce1a4d46-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:57 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" returned: 0 in 0.392s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9" released by "delete_volume" :: held 0.960s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Created reservations ['6bcabdd9-96ef-4c42-9f5e-ab74121e64eb', '547fd099-f670-48d3-81e6-7ef56e11e4f1', '078a43c9-f0bf-49e7-ab41-9ab7aafb48ed', 'e64b53c3-17c9-4024-9798-b309682d48b8'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:57 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.955s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:57 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Cloning volume b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 to volume 7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e539b0-b9f1-4cba-8999-9a9945fcd90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623a8316-9447-4aa8-8df6-7ee17931109c', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3b67d2-759a-4ded-86de-0565ec35e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:57 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Volume volume-623a8316-9447-4aa8-8df6-7ee17931109c (623a8316-9447-4aa8-8df6-7ee17931109c): created successfully Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3b67d2-759a-4ded-86de-0565ec35e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Flow 'volume_create_manager' (6a99227a-d3f4-4ed8-805d-db84f043de03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:57 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Creating offline snapshot dd956814-d815-48ed-8a5a-1e1ce788b5fb of volume b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-59479eb0-e2ef-4c0e-bba7-c94f92117a39-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[90378155-6d59-499f-b4ae-4a61d4f5ef00]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:58 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-fc018778-91ab-46da-bad8-43df968d4b92 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created volume successfully. Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:58 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:58 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-59479eb0-e2ef-4c0e-bba7-c94f92117a39-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "cinder-quobyte-59479eb0-e2ef-4c0e-bba7-c94f92117a39" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-59479eb0-e2ef-4c0e-bba7-c94f92117a39" acquired by "delete_volume" :: waited 0.008s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aed0df1-1c24-4475-a186-bcd9dc4db2ea]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:58 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 Apr 15 16:17:58 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:58 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 Apr 15 16:17:58 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:58 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.565s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:58 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Deleted volume successfully. Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-54ae4f85-9b00-4445-857e-4942b0888787 tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-d041b87e-48a0-4d91-9b09-bd7fe17a6ca9-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-623a8316-9447-4aa8-8df6-7ee17931109c-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-623a8316-9447-4aa8-8df6-7ee17931109c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-quobyte-623a8316-9447-4aa8-8df6-7ee17931109c" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:17:58 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-623a8316-9447-4aa8-8df6-7ee17931109c" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" returned: 0 in 0.638s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7533e166-5719-42a0-bc1d-5d8a576945e6]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:58 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb 1G Apr 15 16:17:58 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:58 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39" returned: 0 in 0.640s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:58 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:58 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c Apr 15 16:17:58 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:58 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39 Apr 15 16:17:58 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:59 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb 1G" returned: 0 in 0.562s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:59 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb Apr 15 16:17:59 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:59 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c" returned: 0 in 0.588s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:59 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c Apr 15 16:17:59 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:59 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-59479eb0-e2ef-4c0e-bba7-c94f92117a39" returned: 0 in 0.576s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-quobyte-59479eb0-e2ef-4c0e-bba7-c94f92117a39" released by "delete_volume" :: held 1.240s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Created reservations ['e7e27cec-ab3d-4340-be36-3eb5abcb356c', 'a5dea02a-088b-4a27-a0b4-d16d107f6475', '02c95d98-6f6f-42b0-b1de-ace48170def2', 'aa7f8760-73b3-40be-a156-e85f9ae8b3cb'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:59 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:59 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:59 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb" returned: 0 in 0.521s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:59 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb is being set with open permissions: ugo+rw Apr 15 16:17:59 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-623a8316-9447-4aa8-8df6-7ee17931109c" returned: 0 in 0.495s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:59 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb Apr 15 16:17:59 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-623a8316-9447-4aa8-8df6-7ee17931109c" released by "delete_volume" :: held 1.120s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created reservations ['7812efc6-021d-4525-b248-babcdd606277', '183267c5-5e7e-44c2-a05c-bcbd03ca8327', 'eff06728-0c2a-4d08-a3d4-b7484153d2bf', '71b748ae-d062-4ae5-938a-1f5b8f39d286'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:17:59 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:17:59 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Flow 'volume_create_manager' (133040d0-a675-47fd-8549-acc67fe609ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe9abb3-7bf6-4cdd-a87f-9044dcb9f080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:59 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.551s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe9abb3-7bf6-4cdd-a87f-9044dcb9f080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c238e5eb-15e5-451f-aa68-b07f7bacc3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56a46fd373043098849e1735b73b472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:18:00Z,use_quota=True,user_id='423abbc9436b41b2a78afe4977f60cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd063fb-4062-43ef-9ea2-97a265dd9dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd063fb-4062-43ef-9ea2-97a265dd9dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:17:59 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642f33eb-5d13-4470-b298-979509dcec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642f33eb-5d13-4470-b298-979509dcec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c238e5eb-15e5-451f-aa68-b07f7bacc3f9', 'volume_name': 'volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faed17c0-e48f-4b1f-b252-6898e14f71f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faed17c0-e48f-4b1f-b252-6898e14f71f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639244cd-7438-4681-b998-6fce66a1bdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:00 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Volume c238e5eb-15e5-451f-aa68-b07f7bacc3f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9', 'volume_size': 1} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:00 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Deleted volume successfully. Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-473dbcce-e6ed-4143-beef-6b0aa2c7215d tempest-SnapshotDependencyTests-1431119280 None] Lock "cinder-59479eb0-e2ef-4c0e-bba7-c94f92117a39-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:00 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb" returned: 0 in 0.419s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:00 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.info Apr 15 16:18:00 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:00 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.473s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:00 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Deleted volume successfully. Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-48a49503-469a-4fda-bb46-c2744cf48e5d tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-623a8316-9447-4aa8-8df6-7ee17931109c-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:00 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.info" returned: 0 in 0.453s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:00 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.info is being set with open permissions: ugo+rw Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:00 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.info Apr 15 16:18:00 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-337030ab-300a-4b78-9279-a63d16046c89-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-337030ab-300a-4b78-9279-a63d16046c89-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-quobyte-337030ab-300a-4b78-9279-a63d16046c89" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-337030ab-300a-4b78-9279-a63d16046c89" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef9dd7-383a-41ff-bc20-1c756b4c546d]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:00 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:00 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 Apr 15 16:18:00 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:01 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.info" returned: 0 in 0.466s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" by "_copy_volume_from_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] snapshot: dd956814-d815-48ed-8a5a-1e1ce788b5fb, volume: 7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7, {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b694ea-5bdf-45ec-9a6e-af841b676023]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:01 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb Apr 15 16:18:01 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:01 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89" returned: 0 in 0.540s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:01 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89 Apr 15 16:18:01 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:01 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb" returned: 0 in 0.541s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Creating direct copy from snapshot {{(pid=82392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8ea4e8-0318-40d1-b208-1dc580af1fd7]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:01 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 Apr 15 16:18:01 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:01 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-337030ab-300a-4b78-9279-a63d16046c89" returned: 0 in 0.449s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-337030ab-300a-4b78-9279-a63d16046c89" released by "delete_volume" :: held 1.015s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created reservations ['535650fe-6296-492d-aa9b-aa7197193b21', 'af786865-4c96-4688-86b8-c9f8bbcf75ea', 'a2249bbc-b131-4d10-939c-7684f54934af', '4a531a51-598e-4a72-b0d9-5b1cca64e789'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:01 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:01 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:01 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:02 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" returned: 0 in 0.504s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:02 devstack cinder-volume[82392]: DEBUG cinder.utils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Path /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 not found in is_blk_device check {{(pid=82392) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 16:18:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:02 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 Apr 15 16:18:02 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:02 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:02 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.450s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:02 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:02 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Deleted volume successfully. Apr 15 16:18:02 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c9cfb6c0-1826-4a83-9ac3-bbfd8deccfc2 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-337030ab-300a-4b78-9279-a63d16046c89-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-4b7004e4-7cc5-4fcf-ac30-560670fab23e-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-4b7004e4-7cc5-4fcf-ac30-560670fab23e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-quobyte-4b7004e4-7cc5-4fcf-ac30-560670fab23e" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-4b7004e4-7cc5-4fcf-ac30-560670fab23e" acquired by "delete_volume" :: waited 0.020s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec9ae12-92c8-4ecc-93d7-006e4b7e3c39]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:03 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e Apr 15 16:18:03 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG oslo_service.periodic_task [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82392) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:03 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:04 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:04 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:04 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" returned: 0 in 2.159s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e0bd73-a993-4023-a63b-9b501a769e55]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:04 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 Apr 15 16:18:04 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:04 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e" returned: 0 in 1.302s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:04 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e Apr 15 16:18:04 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:04 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.657s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-2a97eaf7-ec24-442d-a828-1f08c2bc8ef0 None None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:04 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" returned: 0 in 0.615s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG cinder.image.image_utils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 {{(pid=82392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 16:18:04 devstack cinder-volume[82392]: INFO cinder.image.image_utils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Converted 1024.00 MB image at 474.01 MB/s Apr 15 16:18:04 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 is being set with open permissions: ugo+rw Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:04 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-4b7004e4-7cc5-4fcf-ac30-560670fab23e" returned: 0 in 0.473s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:04 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-4b7004e4-7cc5-4fcf-ac30-560670fab23e" released by "delete_volume" :: held 1.821s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:04 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 Apr 15 16:18:05 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created reservations ['473c9566-2a18-4d02-b65c-ed202acb6e57', 'ea2734f5-7557-436b-923f-741b3085e8ce', 'd49f5e40-287a-4858-b304-e1031ca4c10d', '415c4bf6-075f-4091-b01d-7c22893d37d5'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:05 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:05 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-3217ec92-8290-46f6-8805-2d498876509f-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-3217ec92-8290-46f6-8805-2d498876509f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:05 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-quobyte-3217ec92-8290-46f6-8805-2d498876509f" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" returned: 0 in 0.460s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-3217ec92-8290-46f6-8805-2d498876509f" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" released by "_copy_volume_from_snapshot" :: held 4.337s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[37503f98-388b-4aa4-bc39-5d3c903569f1]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-dd956814-d815-48ed-8a5a-1e1ce788b5fb" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-dd956814-d815-48ed-8a5a-1e1ce788b5fb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Deleting offline snapshot dd956814-d815-48ed-8a5a-1e1ce788b5fb of volume b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] snapshot_file for this snap is: volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb59564d-21a1-432c-945b-680cf9f669b8]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:05 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f Apr 15 16:18:05 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:05 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.492s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:05 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Deleted volume successfully. Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-0dab5069-db5d-4158-8a00-a315e4d7b4f8 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-4b7004e4-7cc5-4fcf-ac30-560670fab23e-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:05 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb Apr 15 16:18:05 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:05 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f" returned: 0 in 0.500s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:05 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:05 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f Apr 15 16:18:05 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:06 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb" returned: 0 in 0.553s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c36aa4b-6707-49f1-9899-2d604154fe35]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:06 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 Apr 15 16:18:06 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:06 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-3217ec92-8290-46f6-8805-2d498876509f" returned: 0 in 0.451s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-3217ec92-8290-46f6-8805-2d498876509f" released by "delete_volume" :: held 0.975s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created reservations ['a119fc2d-9190-4c79-8a77-521fac26c514', 'e4f2dfaf-00d5-4775-9e6a-9f954d9070e0', '28033c5f-bb2b-4150-b9c9-2d21d4ab7e83', '51272104-ac09-45ce-9cab-8721b2e4cf4b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:06 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:06 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:06 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" returned: 0 in 0.636s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:06 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb Apr 15 16:18:06 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:06 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.469s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:06 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Deleted volume successfully. Apr 15 16:18:06 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c5144c-aaee-44b6-92cc-12abdffd4e5a tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-3217ec92-8290-46f6-8805-2d498876509f-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:07 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb" returned: 0 in 0.527s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:07 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb Apr 15 16:18:07 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-9a8ee8e8-9fa5-4878-877c-63d797bb3e80-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-9a8ee8e8-9fa5-4878-877c-63d797bb3e80-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-quobyte-9a8ee8e8-9fa5-4878-877c-63d797bb3e80" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-9a8ee8e8-9fa5-4878-877c-63d797bb3e80" acquired by "delete_volume" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38f27cb-7d02-4699-a7e4-f51fc421959b]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:07 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 Apr 15 16:18:07 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:07 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203.dd956814-d815-48ed-8a5a-1e1ce788b5fb" returned: 0 in 0.534s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-dd956814-d815-48ed-8a5a-1e1ce788b5fb" released by "_delete_snapshot" :: held 2.308s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.885s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.800s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c238e5eb-15e5-451f-aa68-b07f7bacc3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56a46fd373043098849e1735b73b472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:18:00Z,use_quota=True,user_id='423abbc9436b41b2a78afe4977f60cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Creating volume c238e5eb-15e5-451f-aa68-b07f7bacc3f9 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:18:07 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2305d34-2c97-4408-98e1-1a9f02e60558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7', 'volume_size': 1, 'source_volid': 'b87923b1-13f2-48e9-aa3b-c5fc0a0f6203', 'source_volstatus': 'available'}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfbe1c1-33d1-4f6f-b71c-2c87ff5c1acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:07 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Volume volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 (7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7): created successfully Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfbe1c1-33d1-4f6f-b71c-2c87ff5c1acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:07 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 1073741824 Apr 15 16:18:07 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:07 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Flow 'volume_create_manager' (82998059-a81b-4d67-be95-03041389c155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:18:07 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-caba6ba9-ebdd-4cca-b223-5f17e84dc8d4 tempest-VolumeDependencyTests-153979939 None] Created volume successfully. Apr 15 16:18:08 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80" returned: 0 in 0.540s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:08 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80 Apr 15 16:18:08 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:08 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 1073741824" returned: 0 in 0.539s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:08 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 Apr 15 16:18:08 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:08 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-9a8ee8e8-9fa5-4878-877c-63d797bb3e80" returned: 0 in 0.385s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-9a8ee8e8-9fa5-4878-877c-63d797bb3e80" released by "delete_volume" :: held 0.964s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created reservations ['b1b836f1-cb05-4662-a4b5-8d24f1bfb9a5', '950b1d53-a8d4-48d0-ab9f-9189ce111a90', 'c16ac7c1-0c1b-4374-9b6a-da4de3d21b57', 'b2abcad9-6030-47eb-9c53-50fa7153e5d2'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:08 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:08 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-e10eb9a3-a04b-4eb5-808b-50b9d1a22584-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-e10eb9a3-a04b-4eb5-808b-50b9d1a22584-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "cinder-quobyte-e10eb9a3-a04b-4eb5-808b-50b9d1a22584" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-e10eb9a3-a04b-4eb5-808b-50b9d1a22584" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69e045-0ad2-4fba-b8b3-aa8dde00b34a]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:08 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 Apr 15 16:18:08 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:08 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639244cd-7438-4681-b998-6fce66a1bdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7169491-833b-4ea1-873f-54669cafa006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:08 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Volume volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 (c238e5eb-15e5-451f-aa68-b07f7bacc3f9): created successfully Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7169491-833b-4ea1-873f-54669cafa006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Flow 'volume_create_manager' (133040d0-a675-47fd-8549-acc67fe609ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:18:08 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-15a8b938-56fa-4ff4-855c-227690f38ffb tempest-CinderUnicodeTest-1814464385 None] Created volume successfully. Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:08 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" acquired by "delete_volume" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f471b-48d4-46a5-98f8-c9c13dd3e5ef]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:09 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 Apr 15 16:18:09 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:09 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.489s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:09 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Deleted volume successfully. Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-29289bb1-538c-43da-908f-0d65ffb617d6 tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-9a8ee8e8-9fa5-4878-877c-63d797bb3e80-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:09 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584" returned: 0 in 0.486s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:09 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584 Apr 15 16:18:09 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:09 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" returned: 0 in 0.538s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:09 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203 Apr 15 16:18:09 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:09 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-e10eb9a3-a04b-4eb5-808b-50b9d1a22584" returned: 0 in 0.412s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-quobyte-e10eb9a3-a04b-4eb5-808b-50b9d1a22584" released by "delete_volume" :: held 0.921s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Created reservations ['e4cd2c4e-661e-4ddb-aae9-968d7b497c82', '7fb25a47-99c5-4235-b873-a71736e0e445', 'a5eaec34-cd04-44d8-bc95-acc532c60076', 'edbb23ff-03a8-4a37-b011-50e60f92622b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Flow 'volume_create_manager' (fa34aea1-43e4-42b2-ba7d-baa454c05c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e2e19c-0d22-4f85-b680-31beddec8ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:09 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e2e19c-0d22-4f85-b680-31beddec8ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:18:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-157977268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb33183-daeb-4056-b2ce-38201af80853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56a46fd373043098849e1735b73b472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:18:10Z,use_quota=True,user_id='423abbc9436b41b2a78afe4977f60cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:09 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d385b036-c1be-437f-88aa-8e0ae719f2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d385b036-c1be-437f-88aa-8e0ae719f2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b04d0cf-3b8e-449d-aa34-0cbdc27ee53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b04d0cf-3b8e-449d-aa34-0cbdc27ee53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb33183-daeb-4056-b2ce-38201af80853', 'volume_name': 'volume-aeb33183-daeb-4056-b2ce-38201af80853', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030c60b8-2052-4604-965c-1774fe882841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030c60b8-2052-4604-965c-1774fe882841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d8453f-e28f-4442-ae93-0f2e1e8f3046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:09 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Volume aeb33183-daeb-4056-b2ce-38201af80853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb33183-daeb-4056-b2ce-38201af80853', 'volume_size': 1} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T14:18:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-157977268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb33183-daeb-4056-b2ce-38201af80853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56a46fd373043098849e1735b73b472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:18:10Z,use_quota=True,user_id='423abbc9436b41b2a78afe4977f60cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5),volume_type_id=0cc29e0e-c9fe-4533-bf6b-f4b86b3d56e5)}" {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Creating volume aeb33183-daeb-4056-b2ce-38201af80853 {{(pid=82392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Selected osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c as target Quobyte volume. {{(pid=82392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 16:18:09 devstack cinder-volume[82392]: INFO cinder.volume.drivers.remotefs [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] casted to osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c Apr 15 16:18:09 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 1073741824 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:09 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 1073741824 Apr 15 16:18:09 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:10 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" returned: 0 in 0.471s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203" released by "delete_volume" :: held 1.043s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Created reservations ['deb6b837-51b5-420c-8d9a-32c5e17e5b50', '21f2683e-152e-4e11-9c63-a504573a45e2', 'a2e02a2e-f886-48cf-b020-07cc0f31235c', '6157489e-ad70-4d92-a48f-6302c37d631f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:10 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:10 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:10 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.533s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Deleted volume successfully. Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-b31828b8-4c92-4dc1-8702-18305326905c tempest-CreateVolumesFromSourceVolumeTest-1641567954 None] Lock "cinder-e10eb9a3-a04b-4eb5-808b-50b9d1a22584-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:10 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 1073741824" returned: 0 in 0.644s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:10 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 Apr 15 16:18:10 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:10 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.489s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Deleted volume successfully. Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-aabce965-bffa-46c4-8399-0a53de4fa065 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-b87923b1-13f2-48e9-aa3b-c5fc0a0f6203-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:10 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853" returned: 0 in 0.446s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'} {{(pid=82392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d8453f-e28f-4442-ae93-0f2e1e8f3046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb33183-daeb-4056-b2ce-38201af80853', 'volume_size': 1}' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1ad861-aed4-4801-abb7-e954bb2fc472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:INSERT=61,cinder:UPDATE=312,cinder:SELECT=189,cinder:DELETE=22 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:18:10 devstack cinder-volume[82392]: INFO cinder.volume.flows.manager.create_volume [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Volume volume-aeb33183-daeb-4056-b2ce-38201af80853 (aeb33183-daeb-4056-b2ce-38201af80853): created successfully Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1ad861-aed4-4801-abb7-e954bb2fc472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82392) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Flow 'volume_create_manager' (fa34aea1-43e4-42b2-ba7d-baa454c05c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82392) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 16:18:10 devstack cinder-volume[82392]: DEBUG dbcounter [-] [82392] Writing DB stats cinder:SELECT=189,cinder:INSERT=67,cinder:UPDATE=230,cinder:DELETE=27 {{(pid=82392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 16:18:10 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-93c2e307-2f0c-4582-84ca-317a638a9c36 tempest-CinderUnicodeTest-1814464385 None] Created volume successfully. Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c81eaa-6795-48f4-adf6-80187a0ffc40]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:11 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 Apr 15 16:18:11 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:11 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" returned: 0 in 0.498s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:11 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7 Apr 15 16:18:11 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:11 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Creating offline snapshot 5876e809-fff4-4903-8d3b-78d8130e26b0 of volume aeb33183-daeb-4056-b2ce-38201af80853 {{(pid=82392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e8545b-4ffb-48a8-b941-03b64e190033]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:12 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 Apr 15 16:18:12 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:12 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" returned: 0 in 0.452s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7" released by "delete_volume" :: held 0.975s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Created reservations ['7f909f24-6e6b-4618-a26c-51f82c9c787e', 'e462477e-2640-4998-a065-96d7cc5b4ab6', 'b1732c8b-024e-4c8b-8709-6de5aab3d33d', '32ae15b9-d347-483d-96f0-fe0f3e893897'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:12 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:12 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-533b6428-06c5-4e5f-b82a-3f465a4e8945-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-533b6428-06c5-4e5f-b82a-3f465a4e8945-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "cinder-quobyte-533b6428-06c5-4e5f-b82a-3f465a4e8945" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-533b6428-06c5-4e5f-b82a-3f465a4e8945" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf9658-82c2-4452-b546-e8736a285e68]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:12 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 Apr 15 16:18:12 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:12 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853" returned: 0 in 0.485s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 1G {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:12 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 1G Apr 15 16:18:12 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:12 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.443s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:12 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Deleted volume successfully. Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-eb440cc8-2762-4f9d-a829-e7bd4fc502e2 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-7cc2fbf6-6c45-4d8c-a1e8-4e217b9c28f7-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:12 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945" returned: 0 in 0.490s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:12 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945 Apr 15 16:18:12 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:12 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 1G" returned: 0 in 0.487s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:12 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb33183-daeb-4056-b2ce-38201af80853 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:13 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb33183-daeb-4056-b2ce-38201af80853 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 Apr 15 16:18:13 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:13 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-533b6428-06c5-4e5f-b82a-3f465a4e8945" returned: 0 in 0.410s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-quobyte-533b6428-06c5-4e5f-b82a-3f465a4e8945" released by "delete_volume" :: held 0.922s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Created reservations ['4eeb1684-c1a0-42fd-b2ed-1ce8ad1312fd', 'a3a87200-7698-46df-bdda-539cc962d82a', 'ce2dfb68-7d4e-4e48-9481-438b8bd428ca', '6e289578-cd79-463c-86d2-ccc32b60c6cb'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:13 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:13 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:13 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb33183-daeb-4056-b2ce-38201af80853 -F qcow2 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0" returned: 0 in 0.457s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:13 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 is being set with open permissions: ugo+rw Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:13 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 Apr 15 16:18:13 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:13 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.423s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:13 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Deleted volume successfully. Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-ac13c88a-f0ba-4eab-88cc-d80c4ced7d35 tempest-VolumeDependencyTests-153979939 None] Lock "cinder-533b6428-06c5-4e5f-b82a-3f465a4e8945-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:13 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0" returned: 0 in 0.449s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:13 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:13 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.info Apr 15 16:18:13 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:14 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.info" returned: 0 in 0.455s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:14 devstack cinder-volume[82392]: WARNING cinder.volume.drivers.remotefs [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.info is being set with open permissions: ugo+rw Apr 15 16:18:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.info {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:14 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.info Apr 15 16:18:14 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:14 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.info" returned: 0 in 0.394s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:14 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:14 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c64c51de-9190-4f25-b531-49cb81387155 tempest-CinderUnicodeTest-1814464385 None] Create snapshot completed successfully Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "cinder-5876e809-fff4-4903-8d3b-78d8130e26b0-delete_snapshot" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-5876e809-fff4-4903-8d3b-78d8130e26b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "cinder-quobyte-aeb33183-daeb-4056-b2ce-38201af80853" by "delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-quobyte-aeb33183-daeb-4056-b2ce-38201af80853" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "cinder-quobyte-5876e809-fff4-4903-8d3b-78d8130e26b0" by "_delete_snapshot" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-quobyte-5876e809-fff4-4903-8d3b-78d8130e26b0" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Deleting offline snapshot 5876e809-fff4-4903-8d3b-78d8130e26b0 of volume aeb33183-daeb-4056-b2ce-38201af80853 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] snapshot_file for this snap is: volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 {{(pid=82392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5accaeb-c003-4e15-84ee-74da41051d70]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:15 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 Apr 15 16:18:15 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:15 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0" returned: 0 in 0.437s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.remotefs [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeb33183-daeb-4056-b2ce-38201af80853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c4a15-6300-414c-8991-32d03d773946]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:15 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:15 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 Apr 15 16:18:15 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:16 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853" returned: 0 in 0.445s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:16 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 Apr 15 16:18:16 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:16 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0" returned: 0 in 0.421s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:16 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0 Apr 15 16:18:16 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:16 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853.5876e809-fff4-4903-8d3b-78d8130e26b0" returned: 0 in 0.386s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-quobyte-5876e809-fff4-4903-8d3b-78d8130e26b0" released by "_delete_snapshot" :: held 1.746s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-quobyte-aeb33183-daeb-4056-b2ce-38201af80853" released by "delete_snapshot" :: held 1.760s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Created reservations ['fe1f0de4-d9e6-4f83-b12c-76a078773154', '5c1ff2ab-2d03-400b-b5fe-9dbd7ab47e1c', 'cf90ee16-e0b0-4449-bdf5-ddab660f8fd2', 'af01f42b-7fd7-4aca-8d7b-9c0d3831032b'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:16 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Delete snapshot completed successfully. Apr 15 16:18:16 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-bbcbb2f5-b001-4def-a117-181b12741bde tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-5876e809-fff4-4903-8d3b-78d8130e26b0-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "cinder-aeb33183-daeb-4056-b2ce-38201af80853-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-aeb33183-daeb-4056-b2ce-38201af80853-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "cinder-quobyte-aeb33183-daeb-4056-b2ce-38201af80853" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:17 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-quobyte-aeb33183-daeb-4056-b2ce-38201af80853" acquired by "delete_volume" :: waited 0.007s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:17 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ecbdce-da5f-4dd1-bf50-bb90fcd94dba]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:17 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 Apr 15 16:18:17 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:17 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853" returned: 0 in 0.443s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:17 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:17 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853 Apr 15 16:18:17 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:18 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-aeb33183-daeb-4056-b2ce-38201af80853" returned: 0 in 0.387s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-quobyte-aeb33183-daeb-4056-b2ce-38201af80853" released by "delete_volume" :: held 0.862s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Created reservations ['5a87cde4-bb4e-4ddd-97f6-fb94504b3468', 'f6ae6f66-3f0d-4c04-934e-cec45a8ae5d8', '5754d56d-dc33-4f9d-aacc-1d57543590aa', '2e794e51-7709-4c45-8b4d-9a8cd44d07b8'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:18 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:18 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "cinder-c238e5eb-15e5-451f-aa68-b07f7bacc3f9-delete_volume" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-c238e5eb-15e5-451f-aa68-b07f7bacc3f9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "cinder-quobyte-c238e5eb-15e5-451f-aa68-b07f7bacc3f9" by "delete_volume" {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-quobyte-c238e5eb-15e5-451f-aa68-b07f7bacc3f9" acquired by "delete_volume" :: waited 0.006s {{(pid=82392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde7b48b-68fe-46cd-b6c9-aa861a395e73]: (4, 'qcow2') {{(pid=83276) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:18 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 Apr 15 16:18:18 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:18 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.409s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:18 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Deleted volume successfully. Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-40c9094e-589e-40c1-ab5f-931c658bec7d tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-aeb33183-daeb-4056-b2ce-38201af80853-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:18 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9" returned: 0 in 0.441s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:18 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:18 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9 Apr 15 16:18:18 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:19 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9/volume-c238e5eb-15e5-451f-aa68-b07f7bacc3f9" returned: 0 in 0.391s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-quobyte-c238e5eb-15e5-451f-aa68-b07f7bacc3f9" released by "delete_volume" :: held 0.852s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG cinder.quota [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Created reservations ['1a1e2784-13ae-442e-b678-b773bb8f39eb', 'd5e1617b-2459-4e9f-a511-d790138cf0bc', '14a7e93b-b300-46b0-96da-3606dfae84da', 'a6de06fb-92d6-4cc4-a5a2-3dacfb695b1f'] {{(pid=82392) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c': None} {{(pid=82392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a49d1377-4a9d-4a41-98bf-2d107576f76c'] {{(pid=82392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.lockutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 16:18:19 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9 Apr 15 16:18:19 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 16:18:19 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG oslo_concurrency.processutils [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e1007a33bb23649d9ac605ba8a4dcc9" returned: 0 in 0.425s {{(pid=82392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG cinder.manager [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Notifying Schedulers of capabilities ... {{(pid=82392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 16:18:19 devstack cinder-volume[82392]: INFO cinder.volume.manager [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Deleted volume successfully. Apr 15 16:18:19 devstack cinder-volume[82392]: DEBUG cinder.coordination [None req-c5cc28bb-b14f-46ba-bf5e-e7f03032166a tempest-CinderUnicodeTest-1814464385 None] Lock "cinder-c238e5eb-15e5-451f-aa68-b07f7bacc3f9-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=82392) __release /opt/stack/cinder/cinder/coordination.py:152}}